forked from docs/doc-exports
chenxiaoxiong
f9e2808b7c
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com> Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
20 lines
6.0 KiB
HTML
20 lines
6.0 KiB
HTML
<a name="dataartsstudio_01_0137"></a><a name="dataartsstudio_01_0137"></a>
|
||
|
||
<h1 class="topictitle1">HBase/CloudTable Incremental Migration</h1>
|
||
<div id="body32001227"><p id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_p28242048171110">You can use CDM to export data in a specified period of time from HBase (including MRS HBase, FusionInsight HBase, and Apache HBase) and CloudTable. The CDM scheduled jobs can be used together to implement incremental migration of HBase and CloudTable.</p>
|
||
<div class="note" id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_note45791757134910"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_en-us_topic_0108275319_p52974484409">If you have configured a macro variable of date and time and schedule a CDM job through <span id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_en-us_topic_0108275319_text9997118203">DataArts Studio DataArts Factory</span>, the system replaces the macro variable of date and time with (<em id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_en-us_topic_0108275319_i799871152012">Planned start time of the data development job</em> – <em id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_en-us_topic_0108275319_i0998101192020">Offset</em>) rather than (<em id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_en-us_topic_0108275319_i299821132018">Actual start time of the CDM job</em> – <em id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_en-us_topic_0108275319_i129981917200">Offset</em>).</p>
|
||
</div></div>
|
||
<p id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_p1955674331710">When creating a table/file migration job and selecting the link to HBase or CloudTable as the source link, you can set the time range in advanced attributes.</p>
|
||
<div class="fignone" id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_fig55241448173918"><span class="figcap"><b>Figure 1 </b>Time range</span><br><span><img id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_image32865883613" src="en-us_image_0000002269120765.png"></span></div>
|
||
<ul id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_ul10589510174119"><li id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_li958921012415"><span id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_ph12673111844314">Start time (including the value) for extracting data. The format is <em id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_en-us_topic_0108275276_i38211611191413">yyyy-MM-dd HH:mm:ss</em>. Only the data generated at the specified time and later is extracted.</span></li><li id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_li2114124417"><span id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_ph4342049154314">End time (excluding the value) for extracting data. The format is <em id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_en-us_topic_0108275276_i1268214522145">yyyy-MM-dd HH:mm:ss</em>. Only the data generated before the time point is extracted.</span></li></ul>
|
||
<p id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_p1815118591406">The two parameters can be set to <a href="dataartsstudio_01_0114.html">macro variables of date and time</a>. Examples are as follows:</p>
|
||
<ul id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_ul18449143518474"><li id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_li15449183554714">If <strong id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_b84235270613433">Minimum Timestamp</strong> is set to <strong id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_b139242828413430">${dateformat(yyyy-MM-dd HH:mm:ss, -1, DAY)}</strong>, only the data generated after the day before is exported.</li><li id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_li979405319470">If <strong id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_b890522624">Maximum Timestamp</strong> is set to <strong id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_b182810534134512">${dateformat(yyyy-MM-dd HH:mm:ss)}</strong>, only the data generated before the specified time point is exported.</li></ul>
|
||
<p id="dataartsstudio_01_0137__en-us_topic_0000001197579311_en-us_topic_0000001151779050_en-us_topic_0113772483_p588931118499">If both parameters are configured, CDM exports only the data generated on the previous day. In addition, if the job is configured to execute at 00:00:00 every day, the data generated every day can be incrementally synchronized.</p>
|
||
</div>
|
||
<div>
|
||
<div class="familylinks">
|
||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0111.html">Incremental Migration</a></div>
|
||
</div>
|
||
</div>
|
||
|