--- schema_version: "1" id: a758df35b86356ccd99288e291caa86ba67bd8fbef9e2d9bb3b9a195c1e22f10 title: Process Datasets in Near Real Time with On-Demand Processing collection: admin version: current locale: en-us portal_url: https://docs.salesforce.com/admin/current/en-us/ind/264-0-0/dpe_on_demand.md canonical_url: https://help.salesforce.com/s/articleView?id=ind.dpe_on_demand.htm&release=264.0.0&type=5 source_site: help.salesforce.com content_type: documentation content_hash: b2009a9dae5038d5934cd902b12ad8318ce975b23d44aad8861ae3f37491a194 description: Process small to medium datasets in Salesforce and write back results as new or updated records without waiting for a scheduled window. Run near real-time data validations and ad hoc processing from Salesforce objects, context definitions, and CSV files by using on-demand definitions. products: - Cross Cloud release: "264" --- # Process Datasets in Near Real Time with On-Demand Processing Process small to medium datasets in Salesforce and write back results as new or updated records without waiting for a scheduled window. Run near real-time data validations and ad hoc processing from Salesforce objects, context definitions, and CSV files by using on-demand definitions. ### Required Editions
View supported editions.
On-demand definitions can be run in synchronous (immediate) or asynchronous (batch) mode. ## Use Cases for On-Demand Processing - Immediate Analytics: Run definitions whenever your business requires up-to-date data transformations for reporting. - Rapid Data Validation: Verify transformation logic and data quality instantly by triggering runs during configuration. - Ad Hoc Requests: Process one-off data without adjusting complex schedules. - Small Dataset Processing: Handle limited data volumes efficiently without scheduled batch processing. ![Loyalty Score Calculation](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-ind-data_processing_engine-264-0-0-production-enus/80e06924-e6c0-4b82-81cf-e99ccd77d857/images/icon_example.png) Loyalty Score Calculation A Data Processing Engine (DPE) definition calculates a customer's loyalty score based on their purchase history stored in Salesforce objects. Instead of waiting for the nightly batch to run, a service such as a page load or a flow, calls the definition on-demand to get the customer's loyalty score in near real time. - **[Configure a Definition for On-Demand Processing](https://help.salesforce.com/s/articleView?id=ind.dpe_on_demand_configure.htm&release=264.0.0&type=5)** Select the on-demand processing type when you create a Data Processing Engine definition to enable immediate or asynchronous execution. Setting the processing type ensures that the builder shows only the nodes and data sources supported for on-demand processing. - **[Run an On-Demand Definition](https://help.salesforce.com/s/articleView?id=ind.dpe_on_demand_run.htm&release=264.0.0&type=5)** Run an on-demand Data Processing Engine definition directly from the definition builder, or invoke it through a flow by using invocable action, or the run API for synchronous or asynchronous processing. - **[Validate On-Demand Definitions with Data Preview](https://help.salesforce.com/s/articleView?id=ind.dpe_on_demand_data_preview.htm&release=264.0.0&type=5)** Use Data Preview to inspect and validate node-level data transformations in an on-demand definition before you activate and run it. Data Preview for on-demand definitions follows the same workflow as standard Data Processing Engine Data Preview. - **[Monitor and Troubleshoot On-Demand Definition Runs](https://help.salesforce.com/s/articleView?id=ind.dpe_on_demand_monitor.htm&release=264.0.0&type=5)** Monitor on-demand runs, verify write-back results, and troubleshoot failed executions. - **[On-Demand Processing Execution Limits](https://help.salesforce.com/s/articleView?id=ind.dpe_on_demand_limits.htm&release=264.0.0&type=5)** Salesforce Apex guardrails govern on-demand processing of Data Processing Engine (DPE) definitions and are designed for low to moderate data volumes. Review the processing limits and record caps to determine when to use on-demand mode instead of scheduled batch processing. - **[Supported Nodes and Data Sources for On-Demand Processing](https://help.salesforce.com/s/articleView?id=ind.dpe_on_demand_nodes.htm&release=264.0.0&type=5)** Review the data sources and transformation nodes compatible with on-demand processing. On-demand mode is optimized for targeted transformations on Salesforce data. Verify that the transformation logic is compatible before you activate a definition. - **[Integrate Data Processing Engine with Context Service](https://help.salesforce.com/s/articleView?id=ind.dpe_integrate_context_service.htm&release=264.0.0&type=5)** Integrate the Data Processing Engine (DPE) definitions with Context Service to read data from context definitions, transform it, and write it back to a specified JSON structure for downstream processes.