Merge Multiple Data Streams Use Case

The Marketing Cloud Engagement connector in Data 360 uses two profile data streams to ingest data from Marketing Cloud Engagement. Both data streams include the same set of primary keys. When these data streams are mapped directly to the Individual data model object (DMO), duplicate records appear in the DMO. To solve this problem, merge the data streams into one data lake object (DLO) before mapping to the Data 360 data model.

Diagram shows two DLOs merged with two transforms into the same target DLO.

To merge multiple data streams, set up multiple streaming data transforms that write to the same target DLO.