Learn about Data Processing Engine

View supported editions.

Watch the video to see how Data Processing Engine works and how you can use Data Processing Engine to transform data in your org.

If you aren’t able to watch the video in full screen, open the video in a new tab:https://salesforce.vidyard.com/watch/rZzBj9BD6SoW4pM5pnbNeF

After you activate a Data Processing Engine definition, you can use a flow to run it. You can also track each run by using Monitor Workflow Services.

• Data Processing Engine Key Terms
  Browse through this collection of terms, key objects, and key concepts. This collection is designed to give admins, designers, and developers a clear and consistent understanding of concepts to navigate the Data Processing Engine landscape.
• Data Processing Engine Workflow
  Build Data Processing Engine definitions in CRM Analytics and Data 360 runtimes. Use nodes to select data sources, add the data transformation logic, and configure target writeback destinations for the transformation results. Run and monitor Data Processing Engine definitions.
• Data Processing Engine Builder
  The Data Processing Engine builder is a visual interface where you can create, manage, and run Data Processing Engine definitions.
• Data Processing Engine Runtimes
  Data Processing Engine definitions can run either on CRM Analytics (CRMA) or on Data Cloud. Each runtime offers unique capabilities and is suited for different data processing needs. Select a runtime for your definitions based on the complexity of transformations and data volumes.
• Data Processing Engine Node Canvas
  The node canvas provides a visual representation of your definition’s nodes, so you can see how the nodes are related to one another. Each node type has a different color, and the icons indicate what the definition contains.
• Data Processing Engine Best Practices
  Get to know the best practices for creating and running Data Processing Engine definitions.
• Data Processing Engine Limits and Considerations
  When you create and run Data Processing Engine definitions, stay within the limits for your runtime and consider the applicable restrictions. Some limits apply to all runtimes, while others are specific to CRM Analytics or Data 360.
• Supported Objects and Fields for Data Processing Engine
  Data Processing Engine (DPE) works with a broad range of Salesforce object and field types. Use this reference to confirm whether DPE supports an object for Data 360 ingestion, CRM Analytics (CRMA) data sync, and Bulk API 2.0 operations. Knowing the support boundaries up front helps you design transformations that read and write back data reliably.