vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/dws/dev/dws_04_0184.html
Lu, Huayi e6fa411af0 DWS DEV 830.201 version 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Lu, Huayi <luhuayi@huawei.com>
Co-committed-by: Lu, Huayi <luhuayi@huawei.com>
2024-05-16 07:24:04 +00:00

105 lines
36 KiB
HTML
Raw Blame History

<a name="EN-US_TOPIC_0000001233681749"></a><a name="EN-US_TOPIC_0000001233681749"></a>
<h1 class="topictitle1">Uploading Data to OBS</h1>
<div id="body8662426"><div class="section" id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_s4ab41050480e498e902ec36f2681e6c9"><h4 class="sectiontitle">Scenarios</h4><p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_a8d86ee7075b14c6cbab25527f294edd5">Before importing data from OBS to a cluster, prepare source data files and upload these files to OBS. If the data files have been stored on OBS, you only need to complete <a href="#EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l348f74692e3b4bfca287b6be74cfbed3">2</a> to <a href="#EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l04595af7f12b4893b44195f2f3bc227a">3</a> in <a href="#EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_s17a8a2c2b90743c18e649d3c777065df">Uploading Data to OBS</a>.</p>
</div>
<div class="section" id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_s60ae92577e7b4d328d3a17a965691cd0"><h4 class="sectiontitle">Preparing Data Files</h4><p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_a7cb3960df70645df830412b520e89ce8">Prepare source data files to be uploaded to OBS. <span id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145650873_ph1692512422530">GaussDB(DWS)</span> supports only source data files in CSV, TXT, ORC, or CarbonData format.</p>
<p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_a47f770fb1f024628864315a114ff66c1">If user data cannot be saved in CSV format, store the data as any text file.</p>
<div class="note" id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_nbf770c6edc7c4cf4bbf9aad61310e2c5"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_p8507155274014">According to <a href="dws_04_0182.html#EN-US_TOPIC_0000001233883255__en-us_topic_0000001082926905_en-us_topic_0117407705_sefc365e1804e4606aafdeb3398080e73">How Data Is Imported</a>, when the source data file contains a large volume of data, evenly split the file into multiple files before storing it to OBS. The import performance is better when the number of files is an integer multiple of the DN quantity.</p>
</div></div>
</div>
<p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145410931_en-us_topic_0102810712_p141131024112016">Assume that you have stored the following three CSV files in OBS:</p>
<ul id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145410931_en-us_topic_0102810712_en-us_topic_0093837401_ul1362563214337"><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145410931_en-us_topic_0102810712_li1128168125611">Data file <span class="filepath" id="EN-US_TOPIC_0000001233681749__filepath7417174182018"><b>product_info.0</b></span><p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145410931_en-us_topic_0093837401_p963113123569">The file contains the following data:</p>
<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145410931_en-us_topic_0093837401_screen1650215324201"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
<span class="normal">2</span>
<span class="normal">3</span>
<span class="normal">4</span>
<span class="normal">5</span></pre></div></td><td class="code"><div><pre><span></span><span class="mi">100</span><span class="p">,</span><span class="n">XHDK</span><span class="o">-</span><span class="n">A</span><span class="o">-</span><span class="mi">1293</span><span class="o">-#</span><span class="n">fJ3</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">01</span><span class="p">,</span><span class="n">A</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">Autumn</span><span class="w"> </span><span class="k">New</span><span class="w"> </span><span class="n">Shirt</span><span class="w"> </span><span class="n">Women</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">M</span><span class="p">,</span><span class="mi">328</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">04</span><span class="p">,</span><span class="mi">715</span><span class="p">,</span><span class="n">good</span><span class="o">!</span>
<span class="mi">205</span><span class="p">,</span><span class="n">KDKE</span><span class="o">-</span><span class="n">B</span><span class="o">-</span><span class="mi">9947</span><span class="o">-#</span><span class="n">kL5</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">01</span><span class="p">,</span><span class="n">A</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">Autumn</span><span class="w"> </span><span class="k">New</span><span class="w"> </span><span class="n">Knitwear</span><span class="w"> </span><span class="n">Women</span><span class="p">,</span><span class="n">pink</span><span class="p">,</span><span class="n">L</span><span class="p">,</span><span class="mi">584</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">05</span><span class="p">,</span><span class="mi">406</span><span class="p">,</span><span class="n">very</span><span class="w"> </span><span class="n">good</span><span class="o">!</span>
<span class="mi">300</span><span class="p">,</span><span class="n">JODL</span><span class="o">-</span><span class="n">X</span><span class="o">-</span><span class="mi">1937</span><span class="o">-#</span><span class="n">pV7</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">01</span><span class="p">,</span><span class="n">A</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">T</span><span class="o">-</span><span class="n">shirt</span><span class="w"> </span><span class="n">men</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">XL</span><span class="p">,</span><span class="mi">1245</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">03</span><span class="p">,</span><span class="mi">502</span><span class="p">,</span><span class="n">Bad</span><span class="p">.</span>
<span class="mi">310</span><span class="p">,</span><span class="n">QQPX</span><span class="o">-</span><span class="n">R</span><span class="o">-</span><span class="mi">3956</span><span class="o">-#</span><span class="n">aD8</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">02</span><span class="p">,</span><span class="n">B</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">jacket</span><span class="w"> </span><span class="n">women</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">L</span><span class="p">,</span><span class="mi">411</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">05</span><span class="p">,</span><span class="mi">436</span><span class="p">,</span><span class="n">It</span><span class="s1">'s really super nice.</span>
<span class="s1">150,ABEF-C-1820-#mC6,2017-09-03,B,2017 Autumn New Jeans Women,blue,M,1223,2017-09-06,1200,The seller'</span><span class="n">s</span><span class="w"> </span><span class="n">packaging</span><span class="w"> </span><span class="k">is</span><span class="w"> </span><span class="n">exquisite</span><span class="p">.</span>
</pre></div></td></tr></table></div>
</div>
</li><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145410931_en-us_topic_0102810712_li898714135719">Data file <span class="filepath" id="EN-US_TOPIC_0000001233681749__filepath13823619207"><b>product_info.1</b></span><p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145410931_en-us_topic_0093837401_p74235135619">The file contains the following data:</p>
<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145410931_en-us_topic_0093837401_screen46635557330"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
<span class="normal">2</span>
<span class="normal">3</span>
<span class="normal">4</span>
<span class="normal">5</span></pre></div></td><td class="code"><div><pre><span></span><span class="mi">200</span><span class="p">,</span><span class="n">BCQP</span><span class="o">-</span><span class="n">E</span><span class="o">-</span><span class="mi">2365</span><span class="o">-#</span><span class="n">qE4</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">04</span><span class="p">,</span><span class="n">B</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">casual</span><span class="w"> </span><span class="n">pants</span><span class="w"> </span><span class="n">men</span><span class="p">,</span><span class="n">black</span><span class="p">,</span><span class="n">L</span><span class="p">,</span><span class="mi">997</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">10</span><span class="p">,</span><span class="mi">301</span><span class="p">,</span><span class="n">The</span><span class="w"> </span><span class="n">clothes</span><span class="w"> </span><span class="k">are</span><span class="w"> </span><span class="k">of</span><span class="w"> </span><span class="n">good</span><span class="w"> </span><span class="n">quality</span><span class="p">.</span>
<span class="mi">250</span><span class="p">,</span><span class="n">EABE</span><span class="o">-</span><span class="n">D</span><span class="o">-</span><span class="mi">1476</span><span class="o">-#</span><span class="n">oB1</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">10</span><span class="p">,</span><span class="n">A</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">dress</span><span class="w"> </span><span class="n">women</span><span class="p">,</span><span class="n">black</span><span class="p">,</span><span class="n">S</span><span class="p">,</span><span class="mi">841</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">15</span><span class="p">,</span><span class="mi">299</span><span class="p">,</span><span class="n">Follow</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">store</span><span class="w"> </span><span class="k">for</span><span class="w"> </span><span class="n">a</span><span class="w"> </span><span class="n">long</span><span class="w"> </span><span class="k">time</span><span class="p">.</span>
<span class="mi">108</span><span class="p">,</span><span class="n">CDXK</span><span class="o">-</span><span class="n">F</span><span class="o">-</span><span class="mi">1527</span><span class="o">-#</span><span class="n">pL2</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">11</span><span class="p">,</span><span class="n">A</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">dress</span><span class="w"> </span><span class="n">women</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">M</span><span class="p">,</span><span class="mi">85</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">14</span><span class="p">,</span><span class="mi">22</span><span class="p">,</span><span class="n">It</span><span class="err">'</span><span class="n">s</span><span class="w"> </span><span class="n">really</span><span class="w"> </span><span class="n">amazing</span><span class="w"> </span><span class="k">to</span><span class="w"> </span><span class="n">buy</span><span class="p">.</span>
<span class="mi">450</span><span class="p">,</span><span class="n">MMCE</span><span class="o">-</span><span class="n">H</span><span class="o">-</span><span class="mi">4728</span><span class="o">-#</span><span class="n">nP9</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">11</span><span class="p">,</span><span class="n">A</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">jacket</span><span class="w"> </span><span class="n">women</span><span class="p">,</span><span class="n">white</span><span class="p">,</span><span class="n">M</span><span class="p">,</span><span class="mi">114</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">14</span><span class="p">,</span><span class="mi">22</span><span class="p">,</span><span class="k">Open</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">package</span><span class="w"> </span><span class="k">and</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">clothes</span><span class="w"> </span><span class="n">have</span><span class="w"> </span><span class="k">no</span><span class="w"> </span><span class="n">odor</span><span class="p">.</span>
<span class="mi">260</span><span class="p">,</span><span class="n">OCDA</span><span class="o">-</span><span class="k">G</span><span class="o">-</span><span class="mi">2817</span><span class="o">-#</span><span class="n">bD3</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">12</span><span class="p">,</span><span class="n">B</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">woolen</span><span class="w"> </span><span class="n">coat</span><span class="w"> </span><span class="n">women</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">L</span><span class="p">,</span><span class="mi">2004</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">15</span><span class="p">,</span><span class="mi">826</span><span class="p">,</span><span class="n">Very</span><span class="w"> </span><span class="n">favorite</span><span class="w"> </span><span class="n">clothes</span><span class="p">.</span>
</pre></div></td></tr></table></div>
</div>
</li><li id="EN-US_TOPIC_0000001233681749__li14876942201520">Data file <span class="filepath" id="EN-US_TOPIC_0000001233681749__filepath132013832019"><b>product_info.2</b></span><p id="EN-US_TOPIC_0000001233681749__p3877642111511">The file contains the following data:</p>
<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001233681749__screen3813183211616"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
<span class="normal"> 2</span>
<span class="normal"> 3</span>
<span class="normal"> 4</span>
<span class="normal"> 5</span>
<span class="normal"> 6</span>
<span class="normal"> 7</span>
<span class="normal"> 8</span>
<span class="normal"> 9</span>
<span class="normal">10</span></pre></div></td><td class="code"><div><pre><span></span><span class="mi">980</span><span class="p">,</span><span class="ss">&quot;ZKDS-J&quot;</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">13</span><span class="p">,</span><span class="ss">&quot;B&quot;</span><span class="p">,</span><span class="ss">&quot;2017 Women's Cotton Clothing&quot;</span><span class="p">,</span><span class="ss">&quot;red&quot;</span><span class="p">,</span><span class="ss">&quot;M&quot;</span><span class="p">,</span><span class="mi">112</span><span class="p">,,,</span>
<span class="mi">98</span><span class="p">,</span><span class="ss">&quot;FKQB-I&quot;</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">15</span><span class="p">,</span><span class="ss">&quot;B&quot;</span><span class="p">,</span><span class="ss">&quot;2017 new shoes men&quot;</span><span class="p">,</span><span class="ss">&quot;red&quot;</span><span class="p">,</span><span class="ss">&quot;M&quot;</span><span class="p">,</span><span class="mi">4345</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">18</span><span class="p">,</span><span class="mi">5473</span>
<span class="mi">50</span><span class="p">,</span><span class="ss">&quot;DMQY-K&quot;</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">21</span><span class="p">,</span><span class="ss">&quot;A&quot;</span><span class="p">,</span><span class="ss">&quot;2017 pants men&quot;</span><span class="p">,</span><span class="ss">&quot;red&quot;</span><span class="p">,</span><span class="ss">&quot;37&quot;</span><span class="p">,</span><span class="mi">28</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">25</span><span class="p">,</span><span class="mi">58</span><span class="p">,</span><span class="ss">&quot;good&quot;</span><span class="p">,</span><span class="ss">&quot;good&quot;</span><span class="p">,</span><span class="ss">&quot;good&quot;</span>
<span class="mi">80</span><span class="p">,</span><span class="ss">&quot;GKLW-l&quot;</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">22</span><span class="p">,</span><span class="ss">&quot;A&quot;</span><span class="p">,</span><span class="ss">&quot;2017 Jeans Men&quot;</span><span class="p">,</span><span class="ss">&quot;red&quot;</span><span class="p">,</span><span class="ss">&quot;39&quot;</span><span class="p">,</span><span class="mi">58</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">25</span><span class="p">,</span><span class="mi">72</span><span class="p">,</span><span class="ss">&quot;Very comfortable.&quot;</span>
<span class="mi">30</span><span class="p">,</span><span class="ss">&quot;HWEC-L&quot;</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">23</span><span class="p">,</span><span class="ss">&quot;A&quot;</span><span class="p">,</span><span class="ss">&quot;2017 shoes women&quot;</span><span class="p">,</span><span class="ss">&quot;red&quot;</span><span class="p">,</span><span class="ss">&quot;M&quot;</span><span class="p">,</span><span class="mi">403</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">26</span><span class="p">,</span><span class="mi">607</span><span class="p">,</span><span class="ss">&quot;good!&quot;</span>
<span class="mi">40</span><span class="p">,</span><span class="ss">&quot;IQPD-M&quot;</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">24</span><span class="p">,</span><span class="ss">&quot;B&quot;</span><span class="p">,</span><span class="ss">&quot;2017 new pants Women&quot;</span><span class="p">,</span><span class="ss">&quot;red&quot;</span><span class="p">,</span><span class="ss">&quot;M&quot;</span><span class="p">,</span><span class="mi">35</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">27</span><span class="p">,</span><span class="mi">52</span><span class="p">,</span><span class="ss">&quot;very good.&quot;</span>
<span class="mi">50</span><span class="p">,</span><span class="ss">&quot;LPEC-N&quot;</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">25</span><span class="p">,</span><span class="ss">&quot;B&quot;</span><span class="p">,</span><span class="ss">&quot;2017 dress Women&quot;</span><span class="p">,</span><span class="ss">&quot;red&quot;</span><span class="p">,</span><span class="ss">&quot;M&quot;</span><span class="p">,</span><span class="mi">29</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">28</span><span class="p">,</span><span class="mi">47</span><span class="p">,</span><span class="ss">&quot;not good at all.&quot;</span>
<span class="mi">60</span><span class="p">,</span><span class="ss">&quot;NQAB-O&quot;</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">26</span><span class="p">,</span><span class="ss">&quot;B&quot;</span><span class="p">,</span><span class="ss">&quot;2017 jacket women&quot;</span><span class="p">,</span><span class="ss">&quot;red&quot;</span><span class="p">,</span><span class="ss">&quot;S&quot;</span><span class="p">,</span><span class="mi">69</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">29</span><span class="p">,</span><span class="mi">70</span><span class="p">,</span><span class="ss">&quot;It's beautiful.&quot;</span>
<span class="mi">70</span><span class="p">,</span><span class="ss">&quot;HWNB-P&quot;</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">27</span><span class="p">,</span><span class="ss">&quot;B&quot;</span><span class="p">,</span><span class="ss">&quot;2017 jacket women&quot;</span><span class="p">,</span><span class="ss">&quot;red&quot;</span><span class="p">,</span><span class="ss">&quot;L&quot;</span><span class="p">,</span><span class="mi">30</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">30</span><span class="p">,</span><span class="mi">55</span><span class="p">,</span><span class="ss">&quot;I like it so much&quot;</span>
<span class="mi">80</span><span class="p">,</span><span class="ss">&quot;JKHU-Q&quot;</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">29</span><span class="p">,</span><span class="ss">&quot;C&quot;</span><span class="p">,</span><span class="ss">&quot;2017 T-shirt&quot;</span><span class="p">,</span><span class="ss">&quot;red&quot;</span><span class="p">,</span><span class="ss">&quot;M&quot;</span><span class="p">,</span><span class="mi">90</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">10</span><span class="o">-</span><span class="mi">02</span><span class="p">,</span><span class="mi">82</span><span class="p">,</span><span class="ss">&quot;very good.&quot;</span>
</pre></div></td></tr></table></div>
</div>
</li></ul>
<div class="section" id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_s17a8a2c2b90743c18e649d3c777065df"><a name="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_s17a8a2c2b90743c18e649d3c777065df"></a><a name="en-us_topic_0000001082926859_en-us_topic_0117407656_s17a8a2c2b90743c18e649d3c777065df"></a><h4 class="sectiontitle">Uploading Data to OBS</h4><ol id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_o6d8df37c439846f6908a37a9a10857b0"><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_li2027717715419"><span>Upload data to OBS.</span><p><p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_p179778114113">Store the source data files to be imported in the OBS bucket in advance.</p>
<ol type="a" id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_o476a5e5b07fe4541ab1953478fbd4929"><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l024c42a907f2403195d3e2e1b4320433">Log in to the OBS management console.<p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_a28713feace604f14b7a1cc0571daf013"><a name="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l024c42a907f2403195d3e2e1b4320433"></a><a name="en-us_topic_0000001082926859_en-us_topic_0117407656_l024c42a907f2403195d3e2e1b4320433"></a>Click <span class="uicontrol" id="EN-US_TOPIC_0000001233681749__uicontrol7300577641841"><b>Service List</b></span> and choose <span class="uicontrol" id="EN-US_TOPIC_0000001233681749__uicontrol51516618541841"><b>Object Storage Service</b></span> to open the OBS management console.</p>
</li><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l3a36b8da7bb948e8ba80039e74320cef">Create a bucket.<p id="EN-US_TOPIC_0000001233681749__p13691813101413"><a name="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l3a36b8da7bb948e8ba80039e74320cef"></a><a name="en-us_topic_0000001082926859_en-us_topic_0117407656_l3a36b8da7bb948e8ba80039e74320cef"></a><span id="EN-US_TOPIC_0000001233681749__ph770191320142">For details about how to create an OBS bucket, see "OBS Console Operation Guide &gt; Managing Buckets &gt; Creating a Bucket" in the <em id="EN-US_TOPIC_0000001233681749__i2076245184612">Object Storage Service User Guide</em>.</span></p>
<p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_a72fe63ccbac94a8f97feda51458a2f79">For example, create two buckets named <strong id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145650873_b84235270617142">mybucket</strong> and <strong id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145650873_b84235270617138">mybucket02</strong>.</p>
</li><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l13b4b7608ad64ed1a79a4368da45bbeb">Create a folder.<p id="EN-US_TOPIC_0000001233681749__p1342119104189"><a name="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l13b4b7608ad64ed1a79a4368da45bbeb"></a><a name="en-us_topic_0000001082926859_en-us_topic_0117407656_l13b4b7608ad64ed1a79a4368da45bbeb"></a><span id="EN-US_TOPIC_0000001233681749__ph13422210141812">For details about how to create an OBS bucket, see "OBS Console Operation Guide &gt; Managing Objects &gt; Creating a Folder" in the<em id="EN-US_TOPIC_0000001233681749__i257343216554"> Object Storage Service User Guide</em>.</span></p>
<p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_a7abb9511601b4be7b3fc1ecbda11bbbc">For example:</p>
<ul id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_ub89ac3dd3a784059b364f81142944001"><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_lb7292b7b74d6477a826c1c58c0575c0a">Create a folder named <strong id="EN-US_TOPIC_0000001233681749__b116147921241841">input_data</strong> in the <strong id="EN-US_TOPIC_0000001233681749__b55113853141841">mybucket</strong> OBS bucket.</li><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l5bd9fb357ac7429b9d2e19329381294d">Create a folder named <strong id="EN-US_TOPIC_0000001233681749__b132561471041841">input_data</strong> in the <strong id="EN-US_TOPIC_0000001233681749__b100847619641841">mybucket02</strong> OBS bucket.</li></ul>
</li><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l50e443933bcf448087826bad2d3f45ab">Upload the files.<p id="EN-US_TOPIC_0000001233681749__p1841642132119"><a name="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l50e443933bcf448087826bad2d3f45ab"></a><a name="en-us_topic_0000001082926859_en-us_topic_0117407656_l50e443933bcf448087826bad2d3f45ab"></a><span id="EN-US_TOPIC_0000001233681749__ph11416021192116">For details about how to create an OBS bucket, see "OBS Console Operation Guide &gt; Managing Objects &gt; Uploading a File" in the <em id="EN-US_TOPIC_0000001233681749__i460141035619">Object Storage Service User Guide</em>.</span></p>
<p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_a1845812698a844d78c5ec5ed62b3fd62">For example:</p>
<ul id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_u0361d8aca29b4c838815ad01148e3a6b"><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_ldaf49f3e1cc340d69cba009e07c42bc3">Upload the following data files to the <strong id="EN-US_TOPIC_0000001233681749__b48152470641841">input_data</strong> folder in the <strong id="EN-US_TOPIC_0000001233681749__b89213028741841">mybucket</strong> OBS bucket:<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_s6876cbd8c7274f56a9fb6e73d33ed3f3"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
<span class="normal">2</span></pre></div></td><td class="code"><div><pre><span></span><span class="n">product_info</span><span class="p">.</span><span class="mi">0</span>
<span class="n">product_info</span><span class="p">.</span><span class="mi">1</span>
</pre></div></td></tr></table></div>
</div>
</li><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l407ff6ab324142d8aa4f1351d9900871">Upload the following data file to the <strong id="EN-US_TOPIC_0000001233681749__b205282866141841">input_data</strong> folder in the <strong id="EN-US_TOPIC_0000001233681749__b130639868641841">mybucket02</strong> OBS bucket:<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_s9110fe97551f4dea97566c41b33bbda7"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="n">product_info</span><span class="p">.</span><span class="mi">2</span>
</pre></div></td></tr></table></div>
</div>
</li></ul>
</li></ol>
</p></li><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l348f74692e3b4bfca287b6be74cfbed3"><a name="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l348f74692e3b4bfca287b6be74cfbed3"></a><a name="en-us_topic_0000001082926859_en-us_topic_0117407656_l348f74692e3b4bfca287b6be74cfbed3"></a><span>Obtain the OBS path for storing source data files.</span><p><p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_a5f747825f8834eeb88f543b35dd2ae44">After the source data files are uploaded to an OBS bucket, a globally unique access path is generated. The OBS path of the source data files is the value of the <strong id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001145650873_b31792374576">location</strong> parameter used for creating a foreign table.</p>
<p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_p16290144214342">The OBS path in the <strong id="EN-US_TOPIC_0000001233681749__b12329545183313">location</strong> parameter is in the format of <strong id="EN-US_TOPIC_0000001233681749__b20330184512339">obs://</strong><em id="EN-US_TOPIC_0000001233681749__i1933074503317">bucket_name</em>/<em id="EN-US_TOPIC_0000001233681749__i13330144517334">file_path</em>/</p>
<p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_a04224eabab43467ea91eb44983953a5a">For example, the OBS paths are as follows:</p>
<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_s5bb4d2e12622477aab5a86007d47f22d"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
<span class="normal">2</span>
<span class="normal">3</span></pre></div></td><td class="code"><div><pre><span></span><span class="n">obs</span><span class="p">:</span><span class="o">//</span><span class="n">mybucket</span><span class="o">/</span><span class="n">input_data</span><span class="o">/</span><span class="n">product_info</span><span class="p">.</span><span class="mi">0</span>
<span class="n">obs</span><span class="p">:</span><span class="o">//</span><span class="n">mybucket</span><span class="o">/</span><span class="n">input_data</span><span class="o">/</span><span class="n">product_info</span><span class="p">.</span><span class="mi">1</span>
<span class="n">obs</span><span class="p">:</span><span class="o">//</span><span class="n">mybucket02</span><span class="o">/</span><span class="n">input_data</span><span class="o">/</span><span class="n">product_info</span><span class="p">.</span><span class="mi">2</span>
</pre></div></td></tr></table></div>
</div>
</p></li><li id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l04595af7f12b4893b44195f2f3bc227a"><a name="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_l04595af7f12b4893b44195f2f3bc227a"></a><a name="en-us_topic_0000001082926859_en-us_topic_0117407656_l04595af7f12b4893b44195f2f3bc227a"></a><span>Grant the OBS bucket read permission for the user who will import data.</span><p><p id="EN-US_TOPIC_0000001233681749__en-us_topic_0000001082926859_en-us_topic_0117407656_a27991c78c1384ba39529aa9c011785f8">When importing data from OBS to a cluster, the user must have the read permission for the OBS buckets where the source data files are located. You can configure the ACL for the OBS buckets to grant the read permission to a specific user.</p>
<p id="EN-US_TOPIC_0000001233681749__p68585156247"><span id="EN-US_TOPIC_0000001233681749__ph1585931519241">For details, see "Console Operation Guide &gt; Permission Control &gt; Configuring a Bucket ACL" in <em id="EN-US_TOPIC_0000001233681749__i68685053716">Object Storage Service User Guide</em>.</span></p>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dws_04_0154.html">Importing CSV/TXT Data from the OBS</a></div>
</div>
</div>
View Git Blame Copy Permalink