---
schema_version: "1"
id: fcd55e6dd27e7fd46b3e432d0f031a62b9bb803bc5aa9f9f528a3ddef5f44854
title: Data Refresh Process for Extraction
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/data/264-0-0/c360_a_crm_data_refresh_process_for_extraction.md
canonical_url: https://help.salesforce.com/s/articleView?id=data.c360_a_crm_data_refresh_process_for_extraction.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: d5b476c6a682398d690b56f01fb885828d48c318f76f3c9c8b23900fb0400a1f
description: "Data refreshes have two phases: full refresh, which replaces all destination data, and incremental refresh, which updates data between full refresh runs. You can perform both full and incremental refresh on demand. Learn about the different refresh scenarios, and the special behavior of ContentVersion and Knowledge_kav objects."
products:
  - Data 360
release: "264"
---
# Data Refresh Process for Extraction

Data refreshes have two phases: full refresh, which replaces all destination data, and incremental refresh, which updates data between full refresh runs. You can perform both full and incremental refresh on demand. Learn about the different refresh scenarios, and the special behavior of ContentVersion and Knowledge\_kav objects.

### Required Editions

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small edition"><colgroup><col></colgroup><tbody><tr class=""><td class="slds-cell-wrap" style="vertical-align:top;">Available in: <strong>All Editions</strong> supported by Data 360. See <a href="https://help.salesforce.com/s/articleView?id=data.c360_a_dc_editions.htm&amp;language=en_US" target="_blank">Data 360 edition availability</a>.</td></tr></tbody></table>

**Data Refresh Phases**

There are two phases for data refresh (or data sync):

- Full refresh: The entire source data replaces the entire destination data.
- Incremental refresh: Updates are made in between full refresh cycles. Each incremental update extracts data from the start time of the prior extraction to the current time.

All data refresh phases have two stages:

- Extraction of data from the source org.
- Ingestion of data to the Data 360 target org.

Extraction has to succeed before ingestion begins. The data stream **History** panel shows extraction and ingestion errors or successful ingestions. Data 360 considers ingestion as successful when the data lake object (DLO) contains the extracted data. The history panel doesn’t show a successful extraction, as the subsequent ingestion flow encapsulates it into the success message.

![Note](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-data-data_cloud-264-0-0-production-enus/f3569962-3c9b-4f83-9d0c-b6a574e785da/images/icon_note.png)

Note In rare cases where a data stream fails on extraction, you can assume the data stream is in a bad state. For example, if connectivity between the source and target orgs is interrupted, the refresh can surface the interruption as an error. If the issue is transient but there's no new data to extract, no message is sent.

**Full or Incremental Refresh On Demand**

To minimize unnecessary refreshes and data transfers for objects that don’t require regular refresh, you can perform a full or incremental refresh on demand. To refresh a specific data stream on demand, click the **Refresh Now** button for that stream on the **Data Streams** tab. This table describes the refresh process for different on-demand request scenarios.

![Note](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-data-data_cloud-264-0-0-production-enus/f3569962-3c9b-4f83-9d0c-b6a574e785da/images/icon_note.png)

Note You can't refresh any data stream with a [ContentVersion object](https://developer.salesforce.com/docs/atlas.en-us.object_reference.meta/object_reference/sforce_api_objects_contentversion.htm) on demand, even if you click the **Refresh Now** button.

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small ">
      <colgroup>
        <col style="width:25%">
        <col style="width:25%">
        <col style="width:25%">
        <col style="width:25%">
      </colgroup>
      <thead class="slds-text-title_caps ">
        <tr class="">
          <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d180771e125">on-demand refresh request scenario / refresh history setting</th>
          <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d180771e128">batch</th>
          <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d180771e131">streaming</th>
          <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d180771e134">none</th>
        </tr>
      </thead>
      <tbody>
        <tr class="">
          <td data-label="on-demand refresh request scenario / refresh history setting" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e125 ">
            <p>The data stream is incrementally ingesting since its last periodic full refresh,
              see <a href="https://help.salesforce.com/s/articleView?id=data.c360_a_configure_periodic_full_refresh_schedule.htm&amp;release=264.0.0&amp;type=5" title="The periodic full refresh schedule for a Salesforce CRM connector data stream is determined by a number of variables, including a full refresh interval that you can configure to determine when the full refresh is triggered.">Configure Periodic Full Refresh Schedule</a>.</p>
            <p style="margin-bottom:0;">The user initiates an on-demand incremental refresh.</p>
          </td>

          <td data-label="batch" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e128 ">Data 360 ignores the on-demand request. </td>

          <td data-label="streaming" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e131 ">Data 360 ignores the on- demand request. </td>

          <td data-label="none" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e134 ">Data 360 initiates a new incremental refresh.</td>

        </tr>
        <tr class="">
          <td data-label="on-demand refresh request scenario / refresh history setting" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e125 ">
            <p>The data stream is incrementally ingesting since its last periodic full refresh,
              see <a href="https://help.salesforce.com/s/articleView?id=data.c360_a_configure_periodic_full_refresh_schedule.htm&amp;release=264.0.0&amp;type=5" title="The periodic full refresh schedule for a Salesforce CRM connector data stream is determined by a number of variables, including a full refresh interval that you can configure to determine when the full refresh is triggered.">Configure Periodic Full Refresh Schedule</a>.</p>
            <p style="margin-bottom:0;">The user initiates an on-demand full refresh.</p>
          </td>

          <td data-label="batch" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e128 ">
            <p style="margin-bottom:0;">If there's an existing request, Data 360 cancels it and initiates a new full
              refresh.</p>
          </td>

          <td data-label="streaming" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e131 ">If there's an existing request, Data 360 ignores the full refresh.</td>

          <td data-label="none" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e134 ">
            <p style="margin-bottom:0;">If there's an existing request, Data 360 cancels it and initiates a new full
              refresh.</p>
          </td>

        </tr>
        <tr class="">
          <td data-label="on-demand refresh request scenario / refresh history setting" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e125 ">
            <p>The data stream stopped ingesting in the past due to an error, which is now
              resolved. </p>
            <p>Ingestion hasn't run for a duration greater than the full refresh interval days,
              see <a href="https://help.salesforce.com/s/articleView?id=data.c360_a_crm_data_full_refresh_interval.htm&amp;release=264.0.0&amp;type=5" title="The periodic full refresh schedule for a Salesforce CRM connector data stream is determined by a number of variables, including a full refresh interval that you can configure to determine when the full refresh is triggered. By default, the full refresh configurable interval is disabled (set as None). You can configure its value during a bundle or multi-object data stream deployment or for an existing data stream.">Configure Periodic Full Refresh Interval</a>.</p>
            <p style="margin-bottom:0;">The user initiates an on-demand incremental refresh.</p>
          </td>

          <td data-label="batch" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e128 ">Data 360 triggers a full refresh instead of an incremental refresh.</td>

          <td data-label="streaming" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e131 ">Data 360 triggers a full refresh instead of an incremental refresh.</td>

          <td data-label="none" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e134 ">Data 360 triggers a full refresh instead of an incremental refresh.</td>

        </tr>
        <tr class="">
          <td data-label="on-demand refresh request scenario / refresh history setting" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e125 ">
            <p>The data stream is healthy but hasn't received a request for ingestion for a
              duration greater than the full refresh interval days, see <a href="https://help.salesforce.com/s/articleView?id=data.c360_a_crm_data_full_refresh_interval.htm&amp;release=264.0.0&amp;type=5" title="The periodic full refresh schedule for a Salesforce CRM connector data stream is determined by a number of variables, including a full refresh interval that you can configure to determine when the full refresh is triggered. By default, the full refresh configurable interval is disabled (set as None). You can configure its value during a bundle or multi-object data stream deployment or for an existing data stream.">Configure Periodic Full Refresh Interval</a>.</p>
            <p style="margin-bottom:0;">The user initiates an on-demand incremental refresh.</p>
          </td>

          <td data-label="batch" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e128 ">&nbsp;</td>

          <td data-label="streaming" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e131 ">&nbsp;</td>

          <td data-label="none" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e134 ">Data 360 triggers a full refresh instead of an incremental refresh.</td>

        </tr>
      </tbody>
    </table>

**Knowledge Articles and Content Version Objects Unique Refresh Behavior**

Content version streaming through [ContentVersion objects](https://developer.salesforce.com/docs/atlas.en-us.object_reference.meta/object_reference/sforce_api_objects_contentversion.htm) and knowledge article streaming through [Knowledge\_Kav objects](https://developer.salesforce.com/docs/atlas.en-us.knowledge_dev.meta/knowledge_dev/sforce_api_objects_knowledge__kav.htm) follow unique refreshing patterns.

**Content Version Special Day-Zero Behavior:** Unlike the initial data syncing behavior for other objects, Data 360 doesn’t bring all the ContentVersion object data from the CRM org on the initial sync. Instead, it brings the data that gets created or updated after the time the data stream is created, as part of a full refresh.

**Knowledge Article Refreshing Behavior:**

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small ">
      <colgroup>
        <col style="width:50%">
        <col style="width:50%">
      </colgroup>
      <thead class="slds-text-title_caps ">
        <tr class="">
          <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d180771e300">SYNC type</th>
          <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d180771e303">behavior and scope</th>
        </tr>
      </thead>
      <tbody>
        <tr class="">
          <td data-label="SYNC type" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e300 ">Day-Zero</td>

          <td data-label="behavior and scope" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e303 ">On the initial sync when the data stream is created, Data 360 syncs the latest
            versions of articles.</td>

        </tr>
        <tr class="">
          <td data-label="SYNC type" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e300 ">Incremental Sync</td>

          <td data-label="behavior and scope" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e303 ">
            <ul>
              <li><strong class="uicontrol">New articles</strong>: Data 360 syncs the latest version (status:
                <strong class="uicontrol">Published</strong>) and all their previous versions (status:
                <strong class="uicontrol">Archived</strong>).
              </li>

              <li><strong class="uicontrol">Articles updated during incremental period</strong>: Data 360
                syncs the latest versions and their older versions—only if the older versions get
                updated during the incremental period.</li>

            </ul>
          </td>

        </tr>
        <tr class="">
          <td data-label="SYNC type" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e300 ">Full Refresh (Subsequent)</td>

          <td data-label="behavior and scope" class="slds-cell-wrap" style="vertical-align:top;" headers="d180771e303 ">Data 360 syncs <strong class="uicontrol">Published</strong> articles only.
            <strong class="uicontrol">Archived</strong> articles aren't synced.
          </td>

        </tr>
      </tbody>
    </table>

- **[Configure Periodic Full Refresh Schedule](https://help.salesforce.com/s/articleView?id=data.c360_a_configure_periodic_full_refresh_schedule.htm&release=264.0.0&type=5)**  
    The periodic full refresh schedule for a Salesforce CRM connector data stream is determined by a number of variables, including a full refresh interval that you can configure to determine when the full refresh is triggered.
- **[Configure Periodic Full Refresh Interval](https://help.salesforce.com/s/articleView?id=data.c360_a_crm_data_full_refresh_interval.htm&release=264.0.0&type=5)**  
    The periodic full refresh schedule for a Salesforce CRM connector data stream is determined by a number of variables, including a full refresh interval that you can configure to determine when the full refresh is triggered. By default, the full refresh configurable interval is disabled (set as None). You can configure its value during a bundle or multi-object data stream deployment or for an existing data stream.

#### See Also

- [_Salesforce Help_: Configure Periodic Full Refresh Schedule](https://help.salesforce.com/s/articleView?id=data.c360_a_configure_periodic_full_refresh_schedule.htm&release=264.0.0&type=5 "The periodic full refresh schedule for a Salesforce CRM connector data stream is determined by a number of variables, including a full refresh interval that you can configure to determine when the full refresh is triggered.")