Files

Su, Xiaomeng b8dbeabef4 dli_umn_20250929

Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>

2025-11-26 09:25:57 +00:00

11 KiB

Raw Blame History

Common Development Methods for DLI Cross-Source Analysis

Cross-Source Analysis

If DLI needs to access external data sources, you need to establish enhanced datasource connections to enable the network between DLI and the data sources, and then develop different types of jobs to access the data sources. This is the process of DLI cross-source analysis.

This section describes how to develop data sources supported by DLI for cross-source analysis.

Notes

Flink jobs can directly access DIS, OBS, and SMN data sources without using datasource connections.
You are advised to use enhanced datasource connections to connect DLI to data sources.

DLI Supported Data Sources

Table 1 lists the data sources supported by DLI. For how to use the data sources, see Data Lake Insight SQL Syntax Reference.

**Table 1** Supported data sources
Service	SQL Job	Spark Jar Job	Flink SQL Job	Flink Jar Job
APIG	x	x	√	x
CSS	√	√	√	√
DCS Redis	√	√	√	√
DDS	√	√	√	√
DMS for Kafka	x	x	√	√
GaussDB(DWS)	√	√	√	√
MRS HBase	√	√	√	√
MRS Kafka	x	x	√	√
MRS OpenTSDB	√	√	x	√
RDS for MySQL	√	√	√	√
RDS PostGre	√	√	√	√

Parent topic: Configuring the Network Connection Between DLI and Data Sources (Enhanced Datasource Connection)

11 KiB Raw Blame History

Common Development Methods for DLI Cross-Source Analysis

Cross-Source Analysis

Notes

DLI Supported Data Sources

11 KiB

Raw Blame History