DevOps Testing Glossary of Terms

Get familiar with the key terms and concepts related to DevOps Testing.

Required Editions

Available in: Lightning Experience
Available in: Enterprise, Performance, Professional (API access required), Unlimited, and Developer Editions
Code Coverage
The percentage of executable lines of code covered by a test suite. DevOps Testing calculates this value by dividing the total number of lines run by the number of lines in the classes covered by the tests, then multiplying the result by 100. For the default test suite, DevOps Testing fetches the org-wide coverage. Use this value to assess the quality of your test suite. See Testing and Code Coverage.
Quality Gate
The checkpoints that ensure only work items that meet quality criteria move to the next pipeline stage.
Severity
A value ranging from 1 to 5 that helps prioritize failing tests according to their potential impact. DevOps Testing supports these severity levels.
  • 1 - Critical
  • 2 - High
  • 3 - Medium
  • 4 - Low
  • 5 - Info
Test
A set of conditions under which you determine whether a system or change is working as intended.
Test Execution
The process of running a test that is part of a test suite.
Test Provider
A testing solution to automate and manage testing activities. For example, Copado Robotic Testing, Provar Automation, Salesforce Code Analyzer v5, and so on.
Test Suite
A collection of tests for the same test provider.
Test Suite Execution
The process of running a group of tests assigned to a pipeline stage to verify functionality and identify potential issues. A test suite can be run independently or as part of a test suite group.
Test Suite Execution Group
A collection of test suites run for a particular pipeline stage in the DevOps process.