---
schema_version: "1"
id: f1e54187713f4b75b97e26f56b30b92c81f6cb11194e691919c4011f7c555c65
title: DataStreamDefinition
collection: legacydeveloper
version: current
locale: en-us
portal_url: https://docs.salesforce.com/legacydeveloper/current/en-us/api_meta/meta_datastreamdefinition.md
canonical_url: https://developer.salesforce.com/docs/atlas.en-us.api_meta.meta/api_meta/meta_datastreamdefinition.htm
source_site: developer.salesforce.com
content_type: documentation
content_hash: 6eed59ccf2c250c12fbf0ecac2aee28c820a0b10d9c6ce4f5329b6f613789b60
description: Contains data ingestion information such as connection, API, and file retrieval settings.
---
# DataStreamDefinition

Contains data ingestion information such as connection, API, and file retrieval settings.

![Important](https://developer.salesforce.com/docs/atlas.en-us.api_meta.meta/api_meta/images/icon_note_important.png)

#### Important

Where possible, we changed noninclusive terms to align with our company value of Equality. We maintained certain terms to avoid any effect on customer implementations.

## File Suffix and Directory Location

DataStreamDefinition components have the suffix dataStreamDefinition and are stored in the dataStreamDefinitions folder.

## Version

DataStreamDefinition components are available in API version 50.0 and later.

## Special Access Rules

You need the Salesforce CustomizeApplication permission to access this object.

## Fields

<table class="featureTable sort_table" summary="">



          <thead class="thead sorted" align="left">
            <tr>
              <th class="featureTableHeader  " id="d355156e96">Field Name</th>

              <th class="featureTableHeader  " id="d355156e99">Field Type</th>

              <th class="featureTableHeader  " id="d355156e102">Description</th>

            </tr>

          </thead>

          <tbody class="tbody">
            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">areHeadersIncludedInFile</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">boolean</td>

              <td class="entry" headers="d355156e102" data-title="Description">If true, headers are included in the file if this is a single file stream.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">bulkIngest</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">boolean</td>

              <td class="entry" headers="d355156e102" data-title="Description">If true, files are aggregated before data is ingested if the file names contain a
                wildcard. For example, <span class="ph filepath">profiles*.csv</span>.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">definitionCreationType</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">Required. Enum tracks the source of an object or field creation. Valid values are: <ul class="ul bulletList">
                  <li class="li"><samp class="codeph nolang">Custom</samp></li>

                  <li class="li"><samp class="codeph nolang">Standard</samp></li>

                </ul>
                <p class="p">Valid values available in API version 62.0 and later are: </p>
                <a name="ul_qzm_5zd_t2c"><!-- --></a>
                <ul class="ul bulletList" id="ul_qzm_5zd_t2c">
                  <li class="li">
                    <samp class="codeph nolang">ADG</samp>
                  </li>

                  <li class="li"><samp class="codeph nolang">Calculated_Insight</samp></li>

                  <li class="li"><samp class="codeph nolang">CG_Audience</samp></li>

                  <li class="li"><samp class="codeph nolang">Chunk</samp></li>

                  <li class="li"><samp class="codeph nolang">Directory_Table</samp></li>

                  <li class="li"><samp class="codeph nolang">External</samp></li>

                  <li class="li"><samp class="codeph nolang">Semantic</samp></li>

                  <li class="li"><samp class="codeph nolang">Transform</samp></li>

                  <li class="li"><samp class="codeph nolang">Vector_Embedding </samp></li>

                </ul>
                <p class="p">Valid values available in API version 67.0 and later are: </p>
                <a name="ul_tbp_ls3_tjc"><!-- --></a>
                <ul class="ul bulletList" id="ul_tbp_ls3_tjc">
                  <li class="li"><samp class="codeph nolang">Ad_Audience_Insights</samp></li>

                  <li class="li"><samp class="codeph nolang">Auxiliary</samp></li>

                  <li class="li"><samp class="codeph nolang">Clean_Room</samp></li>

                  <li class="li"><samp class="codeph nolang">Deletion_Records</samp></li>

                  <li class="li"><samp class="codeph nolang">Problem_Records</samp></li>

                </ul>
              </td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">dataConnector</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">Required. Describe whether this data stream definition was created by a customer or by
                an internal system.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">dataConnectorType</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">DataConnectorType (enumeration of type string)</td>

              <td class="entry" headers="d355156e102" data-title="Description">The ingestion data source. Valid values are: <ul class="ul bulletList">
                  <li class="li"><samp class="codeph nolang">ACCOUNTENGAGEMENT</samp></li>

                  <li class="li"><samp class="codeph nolang">AwsS3</samp></li>

                  <li class="li"><samp class="codeph nolang">AzureBlob</samp></li>

                  <li class="li"><samp class="codeph nolang">BIG_QUERY</samp></li>

                  <li class="li"><samp class="codeph nolang">CuratedEntity</samp></li>

                  <li class="li"><samp class="codeph nolang">DataCloud</samp></li>

                  <li class="li"><samp class="codeph nolang">ExternalPlatform</samp></li>

                  <li class="li"><samp class="codeph nolang">GoogleCloudStorage</samp></li>

                  <li class="li"><samp class="codeph nolang">IngestApi</samp></li>

                  <li class="li"><samp class="codeph nolang">REDSHIFT</samp></li>

                  <li class="li"><samp class="codeph nolang">SalesforceCommerceCloud</samp></li>

                  <li class="li"><samp class="codeph nolang">SalesforceDotCom</samp></li>

                  <li class="li"><samp class="codeph nolang">SalesforceInteractionStudio</samp></li>

                  <li class="li"><samp class="codeph nolang">SalesforceMarketingCloud</samp></li>

                  <li class="li"><samp class="codeph nolang">SFTP</samp></li>

                  <li class="li"><samp class="codeph nolang">Snowflake</samp></li>

                  <li class="li"><samp class="codeph nolang">StreamingApp</samp></li>

                  <li class="li"><samp class="codeph nolang">UPLOAD</samp></li>

                </ul>
              </td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">dataExtensionIdentifier</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">For a Marketing Cloud data extension, the unique identifier.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">dataExtractField</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">Name of the transport field that’s used when the extract method is CDC.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">dataExtractMethods</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">DataImportDataExtractMethods (enumeration of type string)</td>

              <td class="entry" headers="d355156e102" data-title="Description">Describes how to identify the data to be extracted. Valid values include: <ul class="ul bulletList">
                  <li class="li"><samp class="codeph nolang">DATETIME_CDC</samp></li>

                  <li class="li"><samp class="codeph nolang">FULL_REFRESH</samp></li>

                  <li class="li"><samp class="codeph nolang">NUMERIC_CDC</samp></li>

                  <li class="li">
                    <samp class="codeph nolang">BINARY_CDC</samp> (reserved for future use)
                  </li>

                </ul>
              </td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">dataPlatDataSetBundle</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">Identifies which data set bundle this definition was created from. Useful in cases
                where the same item can be configured across data connections.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">dataPlatformDataSet</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">The description is provided by the developer.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">dataPlatformDataSetItemName</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">Name of the Data Platform Set Item.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">dataSource</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">Required. A reference to the data source from which the data originated. This is
                usually the API name or a unique system identifier, such as the enterprise ID (EID) of the
                customer in the format <samp class="codeph nolang">MC_&lt;EID&gt;</samp>. Example: <samp class="codeph nolang">MCEnterprise</samp> or <samp class="codeph nolang">MC_12345</samp>.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">description</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">Required. A description of the data stream definition.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">fileNameWildcard</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">File or wildcard (*) used when finding files.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">internalOrganization</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">The name of the internal organization.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">isLimitedToNewFiles</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">boolean</td>

              <td class="entry" headers="d355156e102" data-title="Description">If true, file retrieval is limited to new files.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">isMissingFileFailure</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">boolean</td>

              <td class="entry" headers="d355156e102" data-title="Description">If true, treat the case of missing files as a failure.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">masterLabel</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">Required. UI label for this data stream definition.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">mktDataLakeObject</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">Required. Reference to the landing entity (target) where data will be stored.</td>

            </tr>

            <tr>
              <td class="entry" headers="d355156e96" data-title="Field Name"><span class="keyword parmname">mktDataTranObject</span></td>

              <td class="entry" headers="d355156e99" data-title="Field Type">string</td>

              <td class="entry" headers="d355156e102" data-title="Description">Reference to the object that’s used to transport information from the source to a
                landing entity (target).</td>

            </tr>

          </tbody>

        </table>