Skip to main content
This recipe is for “I have one problematic request — I want to try changes quickly and see what improves.”

​
1) Open the Request Overview page

You can reach a Request detail page from:
  • an Intent Group’s Requests tab, or
  • Test > Evaluations (open a request from a row), or
  • Test Set / Test Run request tables (open a request from a row)
See: Request Overview

​
2) Create a rerun version

On the right side of the Request page, open the Versions panel and click New Rerun. Then:
  1. Select the new rerun version from the Versions list.
  2. Adjust the rerun inputs (for example, model selection and messages as needed).
  3. Click Run Request to execute the rerun.
The rerun will capture a new response and show its basic metrics (time / tokens / cost) in the UI.

​
3) Evaluate the rerun with Sentinels

On the same Request page, use the Evaluation section:
  1. Click Add Evaluation
  2. Select the sentinel(s) you want to run
  3. Click Run Evaluation
This makes it easy to compare sentinel outcomes between the original request and your rerun. See: Evaluating a Request

​
4) Promote the original case into a Test Set (optional)

If this is a case you don’t want to regress on:
  1. Switch back to Original in the Versions panel.
  2. Click Add to Test Set.
  3. Add tags and submit.
Then run a Test Run on that Test Set to verify improvements at scale. See: