vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/dli/sqlreference/dli_08_0348.html
Su, Xiaomeng 04d4597cf3 dli_sqlreference_0511_version 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
2023-11-02 14:34:08 +00:00

126 lines
16 KiB
HTML
Raw Blame History

<a name="dli_08_0348"></a><a name="dli_08_0348"></a>
<h1 class="topictitle1">OpenTSDB Result Table</h1>
<div id="body8662426"><div class="section" id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_section136251123112118"><h4 class="sectiontitle">Function</h4><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p1115710143112">OpenTSDB is a distributed, scalable time series database based on HBase. OpenTSDB is designed to collect monitoring information of a large-scale cluster and query data in seconds, facilitating querying and storing massive amounts of monitoring data in common databases. OpenTSDB can be used for system monitoring and measurement as well as collection and monitoring of IoT data, financial data, and scientific experimental results.</p>
<p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p14403133025618">DLI uses enhanced datasource connections to write the output of Flink jobs to OpenTSDB.</p>
</div>
<div class="section" id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_section8968024102211"><h4 class="sectiontitle">Prerequisites</h4><ul id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_ul190494182319"><li id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_li1390494111232">The OpenTSDB service has been enabled.</li><li id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_li9208841243">An enhanced datasource connection has been created for DLI to connect to OpenTSDB, so that jobs can run on the dedicated queue of DLI and you can set the security group rules as required.
</li></ul>
</div>
<div class="section" id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_section12595150132517"><h4 class="sectiontitle">Syntax</h4><pre class="screen" id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_screen167361602153">create table tsdbSink (
attr_name attr_type
(',' attr_name attr_type)*
)
with (
'connector.type' = 'opentsdb',
'connector.region' = '',
'connector.tsdb-metrics' = '',
'connector.tsdb-timestamps' = '',
'connector.tsdb-values' = '',
'connector.tsdb-tags' = '',
'connector.tsdb-link-address' = ''
);</pre>
</div>
<div class="section" id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_section1954002019312"><h4 class="sectiontitle">Parameters</h4>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_table6648185093119" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_row1264885018316"><th align="left" class="cellrowborder" valign="top" width="27.57275727572757%" id="mcps1.3.4.2.2.4.1.1"><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p18648155019317">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="9.72097209720972%" id="mcps1.3.4.2.2.4.1.2"><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p16488508311">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="62.70627062706271%" id="mcps1.3.4.2.2.4.1.3"><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p1364845018311">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_row186487504319"><td class="cellrowborder" valign="top" width="27.57275727572757%" headers="mcps1.3.4.2.2.4.1.1 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p13648050163110">connector.type</p>
</td>
<td class="cellrowborder" valign="top" width="9.72097209720972%" headers="mcps1.3.4.2.2.4.1.2 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p1364885016318">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="62.70627062706271%" headers="mcps1.3.4.2.2.4.1.3 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p17648250133112">Connector type. Set this parameter to <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b11602147102518">opentsdb</strong>.</p>
</td>
</tr>
<tr id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_row1864812502318"><td class="cellrowborder" valign="top" width="27.57275727572757%" headers="mcps1.3.4.2.2.4.1.1 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p1264895014318">connector.region</p>
</td>
<td class="cellrowborder" valign="top" width="9.72097209720972%" headers="mcps1.3.4.2.2.4.1.2 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p176481750183118">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="62.70627062706271%" headers="mcps1.3.4.2.2.4.1.3 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p18648185019318">Region where OpenTSDB locates</p>
</td>
</tr>
<tr id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_row764895013113"><td class="cellrowborder" valign="top" width="27.57275727572757%" headers="mcps1.3.4.2.2.4.1.1 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p46484504315">connector.tsdb-metrics</p>
</td>
<td class="cellrowborder" valign="top" width="9.72097209720972%" headers="mcps1.3.4.2.2.4.1.2 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p4648175010312">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="62.70627062706271%" headers="mcps1.3.4.2.2.4.1.3 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p72894317333">Metrics of data points, which can be specified through parameter configurations.</p>
<p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p72893318338">The number of metrics must be 1 or the same as the number of <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b06911914172717">connector.tsdb-values</strong>.</p>
<p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p928933123318">Use semicolons (;) to separate multiple metrics.</p>
</td>
</tr>
<tr id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_row2648145083117"><td class="cellrowborder" valign="top" width="27.57275727572757%" headers="mcps1.3.4.2.2.4.1.1 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p8648185019316">connector.tsdb-timestamps</p>
</td>
<td class="cellrowborder" valign="top" width="9.72097209720972%" headers="mcps1.3.4.2.2.4.1.2 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p464845033118">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="62.70627062706271%" headers="mcps1.3.4.2.2.4.1.3 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p777510595335">Timestamps of data points. Only dynamic columns are supported.</p>
<p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p18775659173317">The data type can be int, bigint, or string. Only numbers are supported.</p>
<p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p19775165910331">The number of metrics must be 1 or the same as the number of <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b3320144542912">connector.tsdb-values</strong>.</p>
<p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p5775145913333">Use semicolons (;) to separate multiple timestamps.</p>
</td>
</tr>
<tr id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_row116481450103110"><td class="cellrowborder" valign="top" width="27.57275727572757%" headers="mcps1.3.4.2.2.4.1.1 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p16488505310">connector.tsdb-values</p>
</td>
<td class="cellrowborder" valign="top" width="9.72097209720972%" headers="mcps1.3.4.2.2.4.1.2 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p19648250163116">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="62.70627062706271%" headers="mcps1.3.4.2.2.4.1.3 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p5125154618348">Values of data points. You can specify dynamic columns or constant values.</p>
<p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p16125184623420">Separate multiple values with semicolons (;).</p>
</td>
</tr>
<tr id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_row4648115053116"><td class="cellrowborder" valign="top" width="27.57275727572757%" headers="mcps1.3.4.2.2.4.1.1 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p12648175016315">connector.tsdb-tags</p>
</td>
<td class="cellrowborder" valign="top" width="9.72097209720972%" headers="mcps1.3.4.2.2.4.1.2 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p17648750143112">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="62.70627062706271%" headers="mcps1.3.4.2.2.4.1.3 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p08591821133620">Tags of data points. Each tag contains at least one tag value and a maximum of eight tag values. Separate multiple tags by commas (,). You can specify the tags by parameters.</p>
<p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p38593213361">The number of metrics must be 1 or the same as the number of <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b2017012476384">connector.tsdb-values</strong>.</p>
<p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p28591521103614">Separate multiple tags with semicolons (;).</p>
</td>
</tr>
<tr id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_row4648950103114"><td class="cellrowborder" valign="top" width="27.57275727572757%" headers="mcps1.3.4.2.2.4.1.1 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p064865015313">connector.batch-insert-data-num</p>
</td>
<td class="cellrowborder" valign="top" width="9.72097209720972%" headers="mcps1.3.4.2.2.4.1.2 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p064845011318">No</p>
</td>
<td class="cellrowborder" valign="top" width="62.70627062706271%" headers="mcps1.3.4.2.2.4.1.3 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p86485504311">Number of data records to be written in batches at a time. The value must be a positive integer. The default value is <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b56997269397">8</strong>.</p>
</td>
</tr>
<tr id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_row964805014319"><td class="cellrowborder" valign="top" width="27.57275727572757%" headers="mcps1.3.4.2.2.4.1.1 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p20648115083120">connector.tsdb-link-address</p>
</td>
<td class="cellrowborder" valign="top" width="9.72097209720972%" headers="mcps1.3.4.2.2.4.1.2 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p2648115073113">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="62.70627062706271%" headers="mcps1.3.4.2.2.4.1.3 "><p id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_p264865017311">OpenTSDB address for connecting to the cluster where the data to be inserted belongs.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_section12511145743611"><h4 class="sectiontitle">Precautions</h4><ul id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_ul13866941153911"><li id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_li286664118393">If your OpenTSDB runs in an MRS cluster, ensure that:<ol id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_ol615214391371"><li id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_li51521939133718">The IP address and port number of OpenTSDB must be obtained from <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b184543121429">tsd.network.bind</strong> and <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b15895151419425">tsd.network.port</strong> in the OpenTSDB service configuration.</li><li id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_li31521839153716">If <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b597220542425">tsd.https.enabled</strong> is set to <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b154721556154217">true</strong>, the value format of <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b14934160104311">connector.tsdb-link-address</strong> in the SQL statement is <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b6481355194617">https://</strong><em id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_i779421515437">ip:port</em>. If <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b1469720347468">tsd.https.enabled</strong> is set to <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b1429893624611">false</strong>, the value of <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b172061639114615">connector.tsdb-link-address</strong> can be in the format of <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b417572384718">http://</strong><em id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_i1322502774717">ip:port</em> or <em id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_i9675103015474">ip:port</em>.</li><li id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_li6152143923714">When establishing an enhanced datasource connection, you need to add the mapping between MRS cluster hosts and IP addresses in <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b677155818474">/etc/hosts</strong> to the Host Information parameter.</li></ol>
</li></ul>
<ul id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_ul11489202364019"><li id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_li248992394013">If a configuration item can be specified through parameter configurations, one or more columns in the record can be used as part of the configuration item. For example, if the configuration item is set to <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b266311113503">car_$ {car_brand}</strong> and the value of <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b1266991115016">car_brand</strong> in a record is <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b126694113504">BMW</strong>, the value of this configuration item is <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b46692011185018">car_BMW</strong> in the record.</li><li id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_li15956185134118">If dynamic columns are supported, the format must be ${columnName}, where <strong id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_b772403514503">columnName</strong> indicates a field name.</li></ul>
</div>
<div class="section" id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_section1215916487379"><h4 class="sectiontitle">Example</h4><pre class="screen" id="dli_08_0348__en-us_topic_0000001210473628_en-us_topic_0000001177513199_screen842195313386">create table sink1(
attr1 bigint,
attr2 int,
attr3 int
) with (
'connector.type' = 'opentsdb',
'connector.region' = '',
'connector.tsdb-metrics' = '',
'connector.tsdb-timestamps' = '${attr1}',
'connector.tsdb-values' = '${attr2};10',
'connector.tsdb-tags' = 'key1:value1,key2:value2;key3:value3',
'connector.tsdb-link-address' = ''
);</pre>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_08_0307.html">Creating a Result Table</a></div>
</div>
</div>
View Git Blame Copy Permalink