---
schema_version: "1"
id: 9a6cb32ff11ae1799a9431c3bf2c849718c891cb8c859e6fef99126df835d4e4
title: Processing Frequency for Identity Resolution
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/data/264-0-0/c360_a_identity_resolution_processing_frequency.md
canonical_url: https://help.salesforce.com/s/articleView?id=data.c360_a_identity_resolution_processing_frequency.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: a2a55bf91f12396d53a0f326c255dea3c59e58b24e8c7fbab624b0805d7f3fdd
description: Identity resolution processes rulesets as frequently as every 60 minutes to 24 hours, depending on the data source. Each data source is processed on its own timeline according to when data is received and how many changes accumulate.
products:
  - Data 360
release: "264"
---
# Processing Frequency for Identity Resolution

Identity resolution processes rulesets as frequently as every 60 minutes to 24 hours, depending on the data source. Each data source is processed on its own timeline according to when data is received and how many changes accumulate.

To process all data sooner, run the ruleset manually or kick it off with an API command. Rulesets won’t run if no records have changed since the previous run.

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small " summary="Identity Resolution Processing Frequency">
      <caption>Identity Resolution Processing Frequency</caption>
      <colgroup>
        <col style="width:25%">
        <col style="width:25%">
        <col style="width:25%">
        <col style="width:25%">
      </colgroup>
      <thead class="slds-text-title_caps ">
        <tr class="">
          <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d160911e46">Data Source</th>
          <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d160911e49">Connectors</th>
          <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d160911e52">data preprocessing?</th>
          <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d160911e55">processing frequency</th>
        </tr>
      </thead>
      <tbody>
        <tr class="">
          <td data-label="Data Source" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e46 ">
            <ul>
              <li>Initial ingestion by a new data stream</li>

              <li>Full refresh of a data source</li>

              <li>Batch updates with more than 1 million records</li>

            </ul>
          </td>

          <td data-label="Connectors" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e49 ">Any ingestion connector</td>

          <td data-label="data preprocessing?" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e52 ">Yes</td>

          <td data-label="processing frequency" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e55 ">Up to 18 hours</td>

        </tr>
        <tr class="">
          <td data-label="Data Source" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e46 ">
            <ul>
              <li>Streaming ingestion connectors after the initial ingestion</li>

              <li>Batch updates with more than 1 million records</li>

            </ul>
          </td>

          <td data-label="Connectors" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e49 ">
            <p>Streaming ingestion connectors</p>
            <ul>
              <li>Website and Mobile App Connections</li>

              <li>Ingestion API</li>

              <li>Other connectors that use a streaming ingestion method</li>

            </ul>
            <p style="margin-bottom:0;">Any batch ingestion connector</p>
          </td>

          <td data-label="data preprocessing?" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e52 ">No, because the data stream only includes new and changed records</td>

          <td data-label="processing frequency" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e55 ">1 hour or when 500 changes accumulate in change data capture, whichever is
            sooner</td>

        </tr>
        <tr class="">
          <td data-label="Data Source" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e46 ">Federated Data</td>

          <td data-label="Connectors" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e49 ">
            <p>Zero Copy Data Federation (Accelerated)</p>
            <ul>
              <li>Amazon Redshift</li>

              <li>Databricks</li>

              <li>Google Big Query</li>

              <li>Snowflake</li>

            </ul>
          </td>

          <td data-label="data preprocessing?" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e52 ">Yes</td>

          <td data-label="processing frequency" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e55 ">When accelerated data is received, as often as every 1 hour</td>

        </tr>
        <tr class="">
          <td data-label="Data Source" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e46 ">Federated Data</td>

          <td data-label="Connectors" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e49 ">
            <p>Zero Copy Data Federated (Non-accelerated)</p>
            <ul>
              <li>Amazon Redshift</li>

              <li>Databricks</li>

              <li>Google Big Query</li>

              <li>Snowflake</li>

            </ul>
          </td>

          <td data-label="data preprocessing?" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e52 ">Yes</td>

          <td data-label="processing frequency" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e55 ">Up to 24 hours</td>

        </tr>
        <tr class="">
          <td data-label="Data Source" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e46 ">Real-time data</td>

          <td data-label="Connectors" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e49 ">Data 360 Web SDK</td>

          <td data-label="data preprocessing?" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e52 ">No</td>

          <td data-label="processing frequency" class="slds-cell-wrap" style="vertical-align:top;" headers="d160911e55 ">Immediately</td>

        </tr>
      </tbody>
    </table>

For a complete list of connectors, see [Data 360: Connectors and Integrations](https://help.salesforce.com/s/articleView?id=data.c360_a_sources_targets.htm&type=5&language=en_US).

## Data Preprocessing in Identity Resolution

Data from batch and federated sources is preprocessed to remove records that don't need to be match before source records are sent to identity resolution. This ensures that identity resolution is only processing records that are new or changed, and isn’t rerunning unchanged source records. Preprocessing helps identity resolution run rulesets faster in order to achieve incremental processing, and ensures that credits aren’t consumed by running identity resolution on records that have already been unified in their current form.

To determine if a record is new or changed, source records are converted to an MD5 hash value. The hash value of each record is compared to the hash values of records previously run by identity resolution. Only records with unique hash values are sent for processing by identity resolution.

![A diagram that shows how records are compared to the hash history. Records that are new or changed are sent to identity resolution for matching.](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-data-data_cloud-264-0-0-production-enus/f3569962-3c9b-4f83-9d0c-b6a574e785da/data_cloud/images/ir_preprocessing.png)

Record preprocessing prevents identity resolution from running unchanged records even if a data source runs a full refresh.