Preview how your definitions transform data and instantly validate and debug definition design right for the builder. Create and run definitions in Data 360 companion orgs. Use a unified view to track the performance and key metrics of definitions. Get actionable recommentations for failed runs and download failed records to debug faster. Find and focus the Data Processing Engine canvas on nodes that you want to work on.
- Validate Logic and Debug Faster with Data Preview
Validate your definition design instantly during creation. Generate data previews to verify that your configuration meets business needs and to identify logic errors. Use input variables to simulate different runtime conditions and apply data source filters to isolate specific datasets. Easily search the results to check whether definitions are working as expected. Intuitively correlate the results with node configurations and visualize how data flows across nodes. - Run Definitions in Data 360 Companion Orgs
Enhance your multi-org setup by creating definitions in companion orgs to transform data from data model objects (DMOs), data lake objects (DLOs), and calculated insights. You can decouple central business processes orchestrated in the home org from local processes managed in companion orgs. - Get Holistic Insights About Definition Performance in a Single View
Get comprehensive observations about the performance of definitions and their runs on the Analysis tab. Use the tab’s insights to stay informed about duration and data processing volumes for the latest and previous runs. Make informed decisions about your org’s Data Pipeline usage requirements by tracking the execution and writeback utilization numbers. Easily find the reasons and the remedies for failed runs. - Get Actionable Guidance for Failed Runs
Monitoring Workflow Services now provides more contextual messages that identify the root causes of run failure. The messages come with actionable solutions that empower you to fix issues related to definition design, access controls, and runtime platform setup or performance. You also get to know about the exact stage during the execution process when the run failed. - Retrieve Details of Records that Failed Writeback
Download the details of the records that definitions failed to write back. You can individually download the failed records for each Writeback Object node with failed records. Use the failed record details to diagnose issues in the definition or the records that caused the write back to fail. - Monitor Record Group Counts for Composite Writeback
Monitor Workflow Services shows the aggregated count of input, output, and failed record groups for Composite Writeback nodes. Record group counts from child tasks roll up to the node's parent task. Unlike tasks for other nodes, Composite Writeback tasks track record groups generated by the node's grouping logic. - Locate Nodes You're Looking for with Ease
Use advanced search in the Data Processing Engine builder to jump to the node you want to review or reconfigure. When you select a node from the search results, the canvas automatically centers on the selected node and its neighbors. - Data 360 Enhancements in Data Processing Engine
Enhance the transformation logic of definitions with new functions and learn about the count of records processed by nodes. - Changed Objects in Monitor Workflow Services for Data Processing Engine
Do more with the updated Monitor Workflow Services objects.