---
schema_version: "1"
id: 0ee34b1e847f3c7c4da1955c385b4bce547e9356c89bc7b60b067adfe2623c7f
title: Creating Data Streams with TotalConnect
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/mktg/264-0-0/mcidp_data_streams_tc.md
canonical_url: https://help.salesforce.com/s/articleView?id=mktg.mcidp_data_streams_tc.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: c73ecd34ea7588a62c6d00b49402098b4ce70ac5d729817f2236a79e52cc5551
description: If you need to upload data from a source and no API connector exists, you can create a data stream with TotalConnect. For example, if you have a proprietary dataset in Excel, CSV, or another file format, or if a custom report is sent to you by a data partner that is beyond the scope of what their API can provide.
products:
  - Marketing
  - Marketing Cloud Intelligence
release: "264"
---
# Creating Data Streams with TotalConnect

If you need to upload data from a source and no API connector exists, you can create a data stream with TotalConnect. For example, if you have a proprietary dataset in Excel, CSV, or another file format, or if a custom report is sent to you by a data partner that is beyond the scope of what their API can provide.

With TotalConnect, you can either upload a flat file or use a technical vendor. You can define the retrieval method, for example, if you want to pull your data via an HTTPS server. You can also decide what to do when new data comes in, for example, replace the existing data with the new data or filter out data before it’s loaded.

- **[MDP Create a Data Stream with TotalConnect](https://help.salesforce.com/s/articleView?id=mktg.mcidp_data_streams_tc_uploading.htm&release=264.0.0&type=5)**  
    You can upload data manually, automatically using FTP, or an email address, or by scheduling an update with a technical vendor.
- **[MDP Preview Source Data](https://help.salesforce.com/s/articleView?id=mktg.mcidp_data_streams_tc_preview.htm&release=264.0.0&type=5)**  
    After you upload your data with TotalConnect, a preview of your source data lets you see how MDP reads the raw data, including fields and their types. The table reflects all the fields (columns) from your source file. Each field is defined with a type—text, number, or date—and you change the type if needed. You can also change the date format.
- **[Transformers](https://help.salesforce.com/s/articleView?id=mktg.mcidp_data_streams_tc_transformers.htm&release=264.0.0&type=5)**  
    Transformers are a set of configurations applied to files that are uploaded into Marketing Cloud Intelligence Data Pipelines. Transformers are used to alter the structure of the data files in order to pull the exact data sets you need. They instruct the platform as to what data table must be extracted from your source file allowing you to manipulate the file structure.
- **[MDP Mapping Your Source Data in TotalConnect](https://help.salesforce.com/s/articleView?id=mktg.mcidp_data_streams_tc_mapping.htm&release=264.0.0&type=5)**  
    Mapping connects the source fields in your uploaded file to the corresponding MDP fields. Marketing Cloud Intelligence Data Pipelines uses machine learning algorithms to map your data. The mapping process is similar regardless of which method you use to upload your data, with some minor differences. If you’re using TotalConnect, MDP identifies the most suitable data stream type according to your data and offers an initial mapping suggestion.
- **[MDP Troubleshoot TotalConnect Data Streams](https://help.salesforce.com/s/articleView?id=mktg.mcidp_data_streams_tc_trouble.htm&release=264.0.0&type=5)**  
    Errors can occur that prevent data streams from being created or processed. You can view errors using the Log button. The log contains important technical information and can help you diagnose issues.