forked from docs/doc-exports
Hasko, Vladimir
cfc48b3aed
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-committed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
21 lines
2.4 KiB
HTML
21 lines
2.4 KiB
HTML
<a name="dli_09_0162"></a><a name="dli_09_0162"></a>
|
|
|
|
<h1 class="topictitle1">Stream Ecosystem</h1>
|
|
<div id="body1575018104651"><div class="section" id="dli_09_0162__section1855218487123"><h4 class="sectiontitle">Overview</h4><p id="dli_09_0162__p11165751163414">Built on Flink and Spark, the stream ecosystem is fully compatible with the open-source Flink, Storm, and Spark APIs. It is enhanced in features and improved in performance to provide easy-to-use DLI with low latency and high throughput.</p>
|
|
<div class="p" id="dli_09_0162__p14165195113419">The DLI stream ecosystem includes the cloud service ecosystem, open source ecosystem, and custom stream ecosystem.<ul id="dli_09_0162__ul2165175183418"><li id="dli_09_0162__li1616575193411">Cloud service ecosystems<p id="dli_09_0162__p11656519340"><a name="dli_09_0162__li1616575193411"></a><a name="li1616575193411"></a>DLI can be interconnected with other services by using Stream SQLs. You can directly use SQL statements to read and write data from various cloud services, such as Data Ingestion Service (DIS), Object Storage Service (OBS), CloudTable Service (CloudTable), MapReduce Service (MRS), Relational Database Service (RDS), Simple Message Notification (SMN), and Distributed Cache Service (DCS).</p>
|
|
</li><li id="dli_09_0162__li516515133412">Open-source ecosystems<p id="dli_09_0162__p9165135173419"><a name="dli_09_0162__li516515133412"></a><a name="li516515133412"></a>After connections to other VPCs are established through VPC peering connections, you can access all data sources and output targets (such as Kafka, HBase, and Elasticsearch) supported by Flink and Spark in your dedicated DLI queues.</p>
|
|
</li><li id="dli_09_0162__li1250335412473">Custom stream ecosystems<p id="dli_09_0162__p1849919716482"><a name="dli_09_0162__li1250335412473"></a><a name="li1250335412473"></a>You can compile code to obtain data from the desired cloud ecosystem or open-source ecosystem as the input data of Flink jobs.</p>
|
|
</li></ul>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="dli_09_0162__section1822193412152"><h4 class="sectiontitle">Supported Data Formats</h4><p id="dli_09_0162__p1018126165813">DLI Flink jobs support the following data formats:</p>
|
|
<p id="dli_09_0162__p7323644191518">Avro, Avro_merge, BLOB, CSV, EMAIL, JSON, ORC, Parquet, and XML.</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_09_0202.html">Flink Jar Jobs</a></div>
|
|
</div>
|
|
</div>
|
|
|