Test a Verified Query for Regression in Q&A Calibration

Open a verified query in Q&A Calibration. Tableau Agent runs a regression test that compares the new answer with the query you saved. Retest after a semantic model change.

Required Editions

Available in: Tableau Next
Available in: Enterprise, Performance, and Unlimited Editions
User Permissions Needed
To test a verified query for regression:

Tableau Next Platform Analyst permission set

Tableau Next Analyst permission set

Edit permission for the semantic model

Opening a question classified as Verified or Regression shows the Tableau Agent response. The regression test compares that response with the verified expected query you saved. From All Questions, review the saved query without opening the question. For how a pass and a fail change the classification, see Regression Testing for Verified Queries in Q&A Calibration.

  1. In Tableau Next, click Q&A Calibration.
  2. On All Questions, select a question classified as Verified or Regression.
    After Tableau Agent responds, the regression test runs. Running Regression Test appears while the comparison is in progress.
  3. Read the result at the top of the page.
  4. Click Review Analysis.
    Review Differences opens. The saved query is on the left. The new answer is on the right.
  5. If the page shows The semantic model was updated after this question was last modified. The change may affect data accuracy, click Retest.
    The test runs again.

If the test fails, the classification is Regression, and Tableau Agent stops using the verified query as guidance. Revise the verified query so that it matches the semantic model. After you revise the verified query, continue in Q&A Calibration. If the verified query is still incorrect, calibrate the semantic model.