Results & Monitoring

Test Runs & Suite Runs

View and analyze your test execution results

The Runs page is your central hub for viewing all test executions. It provides two views: suite runs (test plan executions) and individual test runs.

Runs Listing Page

Suite Runs View

Shows all test suite executions with:

ColumnDescription
Test suiteName of the suite that was executed
StatusPass/fail with pass rate (e.g., "45/50 passed")
EnvironmentWhich environment the suite ran against
Triggered byWho or what started the run (manual, scheduler)
Executed atWhen the run started
DurationTotal execution time

The status column also shows a health breakdown on hover, showing how many tests are broken, regressing, flaky, new, recovering, or stable. If any tests were retried, a retry count badge appears.

Failure tags — If failures have been tagged (see Failure Triage), color-coded tags appear inline.

Test Runs View

Shows individual test case executions with:

ColumnDescription
Test caseTC number and name (e.g., TC-123)
StatusStatus badge with attempt count if retried
Executed atWhen the test ran
EnvironmentEnvironment name
BrowserChrome, Firefox, or Safari icon
Triggered byManual or scheduler
DurationExecution time

Tests using datasets show a dataset icon. Tests with unresolved bug reports show a bug icon with count.

Filtering

Both views support filtering by:

  • Date range — All time, last 7/14/30 days
  • Status — Passed, failed, running, cancelled, timeout, pending
  • Entity — Filter by specific suite or test case (multi-select)
  • Failure tags — Filter by tagged failure categories (test runs view only)

Suite Run Detail Page

Click a suite run to see all tests that were executed as part of that suite.

  • Suite name and execution date
  • Overall status badge (Passed, Failed, Running, Cancelled)
  • Environment badge

Actions

  • Stop Execution — Cancel the suite if still running
  • Retry Failed — Retry all failed and timed-out tests in the suite
  • View Test Suite — Navigate to the suite definition

Failure Tag Rollup

If any tests failed and have been tagged, a summary shows tag counts (e.g., "Network Error ×3", "2 untagged").

Test List

All test cases in the suite are listed with:

  • Name — TC number, test name, folder, and failure tags
  • Status — Status badge with retry count
  • Recent Runs — Visual history of the last 10 runs as colored dots (green = passed, red = failed)
  • Browser — Browser icon
  • Duration — Execution time

Click any test to view its detailed results.


Test Run Detail Page

The detail page for an individual test run shows everything you need to understand what happened.

Layout

On larger screens, the page uses a two-column layout:

  • Left panel — Steps list with execution status
  • Right panel — Media viewer (screenshots, video, trace)

Steps List

Every step in the test case is shown with:

  • Status icon — Green check (passed), red X (failed), spinner (running), clock (pending), slash (skipped)
  • Step description — What the step does
  • Execution time — How long the step took
  • Play button — Jump to this step in the video/screenshot replay

The failed step is highlighted. If AI diagnosis is available, it shows:

  • Category — Type of failure (e.g., "Network Error")
  • Root Cause — What went wrong
  • Evidence Summary — Supporting information
  • Technical Details — Stack traces, error messages

Media Viewer

Three tabs are available depending on what was captured:

Screenshots — Step-by-step screenshots showing the visual state at each step. Click through to navigate between steps.

Video — Full video recording of the test execution with playback controls. Seeking the video highlights the corresponding step in the left panel.

Trace — Browser trace data showing network requests, timing, and browser events.

Logs

Each step can have associated console and trace logs. Logs are loaded separately and update in real-time (5-second polling) while a test is running.


Run Statuses

StatusDescription
PendingQueued but not yet started
RunningCurrently executing
PassedCompleted successfully
FailedAn assertion or step failed
TimeoutExceeded the time limit
CancelledManually stopped
SkippedSkipped during execution

Retries & Attempts

How Retries Work

  1. A test runs and fails (or times out)
  2. You click Retry on the test run detail page
  3. A new attempt is created and the test re-executes
  4. The status column shows a retry count badge (e.g., "2×" for 2 attempts)

Viewing Attempts

Each attempt has its own screenshots, video, trace, and logs. Navigate between attempts using the dropdown in the test run header. The URL parameter ?attempt=N controls which attempt you're viewing. By default, the latest attempt is shown.

Suite-Level Retry

On a suite run with failures, click Retry Failed to retry all failed and timed-out tests at once. Only failed tests re-execute — passed tests are not re-run. The suite status returns to "Running" until all retries complete.

Sharing Results

Use the Share button on a test run to create a public link that anyone can access without logging in. Useful for sharing failure details with developers or stakeholders.

Test Runs & Suite Runs | QAbyAI Documentation | QAbyAI Docs