---
schema_version: "1"
id: 6faa2651e4c46af6f12656cec8e53592a05ef2fe12d4f9ec7ee96fabfe0af467
title: FAQs for ETL Integration
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/mktg/264-0-0/mc_pers_etl_integration_faq.md
canonical_url: https://help.salesforce.com/s/articleView?id=mktg.mc_pers_etl_integration_faq.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: d14a21eab1c7c8ae5e7866539659fd77ef42a115ab3a88a3313d5de586395bcc
description: Answers to frequently asked questions about ETL integration in Marketing Cloud Personalization.
products:
  - Marketing
  - Salesforce Personalization
release: "264"
---
# FAQs for ETL Integration

Answers to frequently asked questions about ETL integration in Marketing Cloud Personalization.

## File Processing

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small ">
        <colgroup>
          <col style="width:37.5%">
          <col style="width:62.5%">
        </colgroup>
        <thead class="slds-text-title_caps ">
          <tr class="">
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d8589e41">Question</th>
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d8589e44">Answer</th>
          </tr>
        </thead>
        <tbody>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e41 ">How can I tell if my ETL job is running?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e44 ">On the Feeds Dashboard, select an ETL type to see a historical list of jobs
              associated with that type, sorted descending by date, including any in-progress
              jobs. You see in-progress jobs at the top of the list. If there are no in-progress
              or completed rows in the table, the ETL hasn’t processed any files. The Job Progress
              percentage indicates how far along the job has progressed, with anything above 0%
              and below 100% still in progress. You can review percent success rates of the
              Extract and Transform stages, as well as the commit counts. While a job is
              in-progress, you can review execution to view the logs in real time. For more
              information, see <a href="https://help.salesforce.com/s/articleView?id=mktg.mc_pers_etl_feeds_dashboard.htm&amp;release=264.0.0&amp;type=5" title="The Feeds Dashboard provides details about ETL feed jobs.">Monitor ETL Feed Jobs on the Feeds Dashboard</a>.</td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e41 ">How do I know when the job is finished?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e44 ">A job is finished when Job Progress has reached 100% on the Feeds
              Dashboard.</td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e41 ">Can I run concurrent ETL jobs?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e44 ">
              <p>Yes, as long as the jobs don't update a shared data type, and the jobs are
                within the top ten jobs in the inbound file folder. </p>
              <ul>
                <li>Feeds can't run concurrently if they update a shared data type. For example,
                  if users are referenced in a feed file, another feed file that references users
                  can't run at the same time.</li>

                <li>Ten jobs are considered at a time from the inbound folder. Files in the
                  inbound folder are sorted by filename.</li>

              </ul>
              <p style="margin-bottom:0;">Example: One dataset can have a User ETL job and a Product ETL job running
                simultaneously. However, neither can run at the same time as a Transaction ETL job
                because the Transaction ETL impacts both users and products.</p>
            </td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e41 ">Can I cancel a running ETL job?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e44 ">Yes. To learn more about canceling ETL jobs see <a href="https://help.salesforce.com/s/articleView?id=mktg.mc_pers_etl_manage_jobs_and_feeds.htm&amp;release=264.0.0&amp;type=5" title="By enabling the Cancel level for the Feeds permission setting, you can manage ETL jobs and feed files directly. This permission level provides the ability to cancel running jobs and archive files.">Manage ETL Running Jobs and Feeds</a>. </td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e41 ">
              <p style="margin-bottom:0;" dir="ltr">How do I know if a file was successfully canceled?</p>
            </td>

            <td data-label="Answer" dir="ltr" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e44 ">Check the Feeds Dashboard for the job status. Canceled jobs show a
              status of <strong class="uicontrol">Canceled</strong>. For running jobs, verify the file moved
              from the <samp class="filepath">/processing</samp> directory to the
              <samp class="filepath">/failed</samp> directory.
            </td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e41 ">
              <p style="margin-bottom:0;" dir="ltr">What's the difference between how running and queued jobs are
                canceled?</p>
            </td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e44 ">
              <p dir="ltr">Disabling a feed automatically cancels queued jobs. However, the files
                remain in the <samp class="filepath">/inbound</samp> directory. These files remain in this
                directory until the feed is re-enabled, or until the file retention period
                expires, whichever occurs first.</p>
              <p style="margin-bottom:0;" dir="ltr">Canceling a running ETL job moves the file to the
                <samp class="filepath">/failed</samp> directory.
              </p>
            </td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e41 ">Does an ETL job block updates to its corresponding data type from the Marketing
              Cloud Personalization module of the Salesforce Interactions SDK or Event
              API?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e44 ">No. Data coming from the Marketing Cloud Personalization module of the
              Salesforce Interactions SDK or Event API still update corresponding data types while
              an ETL is running.</td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e41 ">What does <strong class="uicontrol">TBD</strong> mean in the Feeds Dashboard?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e44 ">If there are multiple queued ETLs, you might see <strong class="uicontrol">TBD</strong> in
              the Start Time column if the processing of the target file hasn’t started.
              Alternatively, if you run a test of an ETL that results in an error so file
              extraction doesn’t complete, you see <strong class="uicontrol">TBD</strong> displayed in the
              Feeds Dashboard for that ETL job. This result can occur when, for example, there’s
              no target file selected, or if the target file is empty.</td>

          </tr>
        </tbody>
      </table>

## File Processing Errors

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small ">
        <colgroup>
          <col style="width:37.5%">
          <col style="width:62.5%">
        </colgroup>
        <thead class="slds-text-title_caps ">
          <tr class="">
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d8589e205">Question</th>
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d8589e208">Answer</th>
          </tr>
        </thead>
        <tbody>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e205 ">Why aren't my files processing?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e208 ">Files are automatically processed only when the file names are structured
              correctly and placed in the correct directory. For specifications by feed type, see
              <a href="https://help.salesforce.com/s/articleView?id=mktg.mc_pers_etl_data_feed.htm&amp;release=264.0.0&amp;type=5" title="Use these ETL data feeds for ETL integration.">Available ETL Data Feeds</a>.
            </td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e205 ">How can I use the Feeds Dashboard to view errors during the transform
              stage?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e208 ">To review the job logs that include specific error reports, click the
              <strong class="uicontrol">Review Execution</strong> button while a specific batch is
              highlighted. For more information, see <a href="https://help.salesforce.com/s/articleView?id=mktg.mc_pers_etl_feeds_dashboard.htm&amp;release=264.0.0&amp;type=5" title="The Feeds Dashboard provides details about ETL feed jobs.">Monitor ETL Feed Jobs on the Feeds Dashboard</a>.
            </td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e205 ">Is there an error threshold that can cause a job to fail entirely?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e208 ">Yes. The job fails entirely if the error threshold reaches 10%.</td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e205 ">I have an error message that states "Extract failed most likely due to a column
              or line delimiter." What does this mean?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e208 ">To be processed, the file must be a validly parsable CSV. If it contains
              character mistakes—such as double quotes not closed, or extra commas throughout a
              value—it’s possible that the file doesn’t parse correctly. The log includes the file
              line number that caused the error.</td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e205 ">I have an error message that states <code>Warning: At least one Product is
                  archived. Updates won’t be visible in the UI.</code> What does this
              mean?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e208 ">
              <p>This error message can appear while you perform a product, category, or
                dimension/catalog object ETL upload. It means that at least one of the items in your
                ETL is in an archived state. An item becomes archived by doing one of the following: </p>
              <ul>
                <li>Click <strong class="uicontrol">Delete</strong> next to the item in the Marketing Cloud
                  Personalization catalog</li>

                <li>Send an ETL with a column header of <code>attribute:archived</code> and a
                  value of true</li>

              </ul>
              <p style="margin-bottom:0;">Archived items can’t be returned in any campaign and aren’t visible in the
                Marketing Cloud Personalization catalog. If you want, you can have all items in your
                ETL appear in the catalog and be available to return in a campaign response. To
                unarchive any items that are currently in an archived state, confirm that the
                <code>attribute:archived</code> column is in your ETL file and has a value of
                false.
              </p>
            </td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e205 ">I have an error message that states <code>PolyglotException: At least one
                  groupBy field is required.</code> What does this mean?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e208 ">
              <p>This error message can appear while processing an ETL feed in which the CSV is
                missing data in GroupBy fields. In ETL Feeds, Personalization uses GroupByFields
                to group objects together to make updates to the databases and system at the same
                time for that object. Each ETL file format has its own set of GroupByFields.</p>
              <p style="margin-bottom:0;">For example, if you encounter this message while processing a user profile object
                feed file, understand that this CSV feed's groupBy field requires UserId,
                IdentityField, or both. In this context, the message means that a userId or
                identity attribute header isn't present. For more information, see <a href="https://help.salesforce.com/s/articleView?id=mktg.mc_pers_etl_user_profile_object_data_feed.htm&amp;release=264.0.0&amp;type=5" title="Use the User Profile Object ETL data feed to update the user profile objects you create.">User Profile Object ETL Data Feed</a>.</p>
            </td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e205 ">I have an error message that states <code>AmazonS3Exception: Not
                  Found</code>. What does this mean?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e208 ">
              <p>This error appears when a file is no longer present on the SFTP site when the job
                system starts to process it. This message can occur under the following
                conditions:</p><a name="mc_pers_etl_integration_faq__ul_bjl_s4q_xgc"><!-- --></a>
              <ul id="mc_pers_etl_integration_faq__ul_bjl_s4q_xgc">
                <li>You’ve re-used a filename. Make sure that all filenames are unique.</li>

                <li>Unprocessed files remain on the SFTP site longer than the retention period.
                  The SFTP site retention period for Marketing Cloud Personalization is 60 days.
                  The SFTP site retention period for <span>Data 360</span>, which is where <span>Data 360</span>
                  Activation ETL feed files are stored, is 30 days.</li>

              </ul>
            </td>

          </tr>
        </tbody>
      </table>

## File Requirements

 
| Question | Answer |
| --- | --- |
| What are the character limit counts? | Character limit counts are defined in the specification documents for each available feed type. For more information, see [Available ETL Data Feeds](https://help.salesforce.com/s/articleView?id=mktg.mc_pers_etl_data_feed.htm&release=264.0.0&type=5 "Use these ETL data feeds for ETL integration."). |
| What is the file size limit? | There’s no file size limit. However, Salesforce recommends limiting file sizes to 5 GB. For more information, see [Limits for Marketing Cloud Personalization](https://help.salesforce.com/s/articleView?id=mktg.mc_pers_limits.htm&release=264.0.0&type=5 "Learn about the limits and capabilities in Marketing Cloud Personalization."). |

## Data Management

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small ">
        <colgroup>
          <col style="width:37.5%">
          <col style="width:62.5%">
        </colgroup>
        <thead class="slds-text-title_caps ">
          <tr class="">
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d8589e438">Question</th>
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d8589e441">Answer</th>
          </tr>
        </thead>
        <tbody>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e438 ">Can I unset a user attribute?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e441 ">User ETLs are unique. Often, Personalization receives user data from multiple
              sources that are all canonical. Unlike Item Type ETLs, a blank value in the User ETL
              results in no change to the existing attribute value. For more information, see
              <a href="https://help.salesforce.com/s/articleView?id=mktg.mc_pers_etl_user_data_feed.htm&amp;release=264.0.0&amp;type=5" title="Use the User ETL data feed to update Unified Custom Profiles, and Unified Account Profiles if you have B2B Detect. Personalization stores user profiles for each anonymous and known user in the system.">User ETL Data Feed</a>.
            </td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e438 ">My ETL job appears to have run, but items aren’t listed in the catalog. I see
              only 100 items on the item list page, but my file contained many thousands of items.
              Is everything working correctly?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e441 ">When a catalog has more than 10,000 dfferent catalog items, only items with
              item actions, such as a view or a purchase, appear on the catalog list screen. You
              can still visit catalog edit pages directly by editing the item ID query string of
              an item edit page. Items that have no views or actions attached are hidden from the
              catalog. </td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e438 ">Can I clear all commits related to a recent ETL job?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e441 ">Due to data retention policies, Personalization can’t clear commits related to
              a recent load. You can unset values and attributes as allowed by the ETL type, but
              Personalization can't repair incorrect or incorrectly loaded data.</td>

          </tr>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e438 ">The ETL file completed successfully, but I don't see the updates applied to
              changed products. Is there anything I can check?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e441 ">
              <p>Product updates through ETL or the Marketing Cloud Personalization module of the
                Salesforce Interactions SDK or Event API don’t get applied if the product is
                locked, which occurs when someone manually edits the product's information and
                saves changes. The assumption is that a manual edit is intentional and should take
                precedence over any inbound data source. When you edit a product page, the page
                appears to be locked in the top right-hand corner, but it remains locked only if
                you save an edit. </p>
              <p style="margin-bottom:0;">To see if a product is locked, navigate to the product catalog
                (<strong class="uicontrol">Catalog &gt; Products</strong>). Find the item on the overview
                screen, and look for the lock icon that appears next to the product name in the
                right-hand column (right under the <strong class="uicontrol">Delete</strong> button). If the
                product is locked, double-click to edit the product, select
                <strong class="uicontrol">Unlocked</strong> from the dropdown in the top right, and click
                <strong class="uicontrol">Save</strong>. Unlocking the product allows manual changes (and
                other unchanged attributes) to be updated by ETL, the Marketing Cloud
                Personalization module of the Salesforce Interactions SDK, or the Event API.
              </p>
            </td>

          </tr>
        </tbody>
      </table>

## ETL Customization

 
| Question | Answer |
| --- | --- |
| Can ETLs be customized? | No. ETLs can’t be customized by Personalization support, partners, or customers. |
| How do I know what ETLs are available? | Available ETLs are all documented and available for review in [Available ETL Data Feeds](https://help.salesforce.com/s/articleView?id=mktg.mc_pers_etl_data_feed.htm&release=264.0.0&type=5 "Use these ETL data feeds for ETL integration."). |
| Can I configure the error threshold for a specific ETL? | The error threshold is a constant value that can’t be configured. |

## SFTP Management

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small ">
        <colgroup>
          <col style="width:37.5%">
          <col style="width:62.5%">
        </colgroup>
        <thead class="slds-text-title_caps ">
          <tr class="">
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d8589e596">Question</th>
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d8589e599">Answer</th>
          </tr>
        </thead>
        <tbody>
          <tr class="">
            <td data-label="Question" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e596 ">Can I move a file from testing to inbound in the Feeds Dashboard?</td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e599 ">Files can be placed in the inbound directory only by accessing the
              SFTP.</td>

          </tr>
          <tr class="">
            <td data-label="Question" dir="ltr" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e596 ">How can I reprocess a file that was canceled and is now in the
              <samp class="filepath">/failed</samp> directory?
            </td>

            <td data-label="Answer" class="slds-cell-wrap" style="vertical-align:top;" headers="d8589e599 ">
              <p dir="ltr">To reprocess a failed ETL file, you can upload it manually. See <a href="https://help.salesforce.com/s/articleView?id=mktg.mc_pers_etl_file_upload.htm&amp;release=264.0.0&amp;type=5" title="ETL data feeds are commonly configured to automatically upload the ETL files using the SFTP site. However, you can upload files manually if, for example, you want to ingest data that doesn’t get updated frequently, or if you want to confirm the .CSV file format without committing changes.">Upload an ETL File Manually</a> for details.</p>
              <p style="margin-bottom:0;" dir="ltr">For Data Cloud 360 activation files, resend the activation to avoid
                processing files out of order.</p>
            </td>

          </tr>
        </tbody>
      </table>