---
schema_version: "1"
id: 5dd3f01bac87644af956409ba35399a7deba93ee3a869019f25440198326e001
title: Data Processing Engine Best Practices for Data Sync in CRM Analytics
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/ind/264-0-0/dpe_best_practice_sync.md
canonical_url: https://help.salesforce.com/s/articleView?id=ind.dpe_best_practice_sync.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: b47e698fb277fac71ee9b964804b82c99279a652303e12a00fb1ece6c59dba19
description: After a batch job is created to run a Data Processing Engine definition with CRM Analytics runtime, new and updated records from since the last run are synced in CRM Analytics. To optimize the data sync process during definition runs, adopt a data sync strategy that works best of your company.
products:
  - Cross Cloud
release: "264"
---
# Data Processing Engine Best Practices for Data Sync in CRM Analytics

After a batch job is created to run a Data Processing Engine definition with CRM Analytics runtime, new and updated records from since the last run are synced in CRM Analytics. To optimize the data sync process during definition runs, adopt a data sync strategy that works best of your company.

### Required Editions

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small edition"><colgroup><col></colgroup><tbody><tr class=""><td class="slds-cell-wrap" style="vertical-align:top;"><a href="https://help.salesforce.com/s/articleView?id=ind.dpe_editions.htm&amp;release=264.0.0&amp;type=5" title="Review the supported editions and availability for Data Processing Engine (DPE).">View supported editions</a>.</td></tr></tbody></table>

## Frequency

Based on your org's daily data volumes, you can adopt either of these incremental data sync strategies for objects that are used as data sources in definitions:

 
| Frequency | Best For |
| --- | --- |
| Hourly | When more than 2 million records are created or updated every hour. |
| Daily | When less than 2 million records are created or updated every hour. |

During peak business periods, such as festive seasons and financial year-ends, you can run manual full syncs daily or weekly. CRM Analytics also provides the option for scheduled periodic full syncs. Full syncs help ensure data integrity and reduce data drift.

## Historical Data Filtering

Based on the data protection and privacy regulations of your region, you may need to store customer data for an extended period of time. To make sure that Data Processing Engine definitions don't consider historical data that isn't eligible for transformation, set up data sync filters for objects to make sure definition runs ignore unnecessary data.

#### See Also

- [Schedule, Run, and Monitor Data Sync](https://help.salesforce.com/s/articleView?id=analytics.bi_integrate_schedule_run_monitor_replication.htm&language=en_US)
- [Filter Local Data Synced to CRM Analytics](https://help.salesforce.com/s/articleView?id=analytics.bi_integrate_connectors_salesforce_local_filter.htm&language=en_US)