Interaction Steps

Interaction steps simulate real user actions. QAbyAI uses intelligent element detection — describe what you want to interact with in natural language instead of writing selectors.

AI Magic

Give complex tasks in plain English and let the agent figure out how to complete them. Best for multi-step interactions like date pickers or complex form fills.

Configuration:

• instruction (required): Natural language instruction to execute

Learn more on the AI Magic page.

Extract and Save

Extract content from the page and save it to variables for later use.

Configuration:

• prompt (required): Natural language description of what content to extract
• variableName (required): Variable name to save the extracted content for later use

Navigate

Navigate to any URL in your browser.

Configuration:

• url (required): URL to navigate to
• timeout (optional): Maximum time to wait for navigation

Click

Click on any element using natural descriptions.

Configuration:

• elementDescription (required): Description of element to click
• elementReference (optional): Direct element reference with DOM/UUID or XPath
• waitForDownload (optional): Whether to wait for a download after clicking
• downloadTimeout (optional): Maximum time to wait for download

Type

Type text into input fields, forms, or any editable elements.

Configuration:

• elementDescription (required): Description of input element to type into
• value (required): Text value to type
• replace (optional): Whether to replace existing value (default: append)
• pressEnter (optional): Whether to press Enter after typing
• elementReference (optional): Direct element reference with DOM/UUID or XPath

Select

Choose options from dropdowns, select lists, or combo boxes.

Configuration:

• elementDescription (required): Description of select/dropdown element
• option (required): Option text to select
• elementReference (optional): Direct element reference with DOM/UUID or XPath

Press

Press keyboard keys or key combinations.

Configuration:

• keys (required): Keyboard keys to press (e.g. "Enter", "Escape", "Ctrl+A")

Scroll

Scroll up or down on the page or within specific elements.

Configuration:

• vertical (required): Pixels to scroll vertically (positive=down, negative=up)
• elementDescription (optional): Description of element to hover over when scrolling
• elementReference (optional): Direct element reference with DOM/UUID or XPath

Hover

Hover over elements to trigger hover states or reveal hidden content.

Configuration:

• elementDescription (required): Description of element to hover over
• elementReference (optional): Direct element reference with DOM/UUID or XPath

Drag & Drop

Drag an element from one location and drop it onto another element.

Configuration:

• dragFrom (required): Description of the element to drag
• dragTo (required): Description of the target element to drop onto
• elementReferenceFrom (optional): Direct element reference for the source element
• elementReferenceTo (optional): Direct element reference for the target element

Example use cases:

• Reordering items in a sortable list
• Moving files between folders
• Dragging cards on a Kanban board
• Rearranging dashboard widgets

File Upload

Upload files to file input elements.

Configuration:

• elementDescription (required): Description of file input element
• files (required): Array of files to upload with url and filename properties
• elementReference (optional): Direct element reference with DOM/UUID or XPath

All interaction steps work with QAbyAI's intelligent element detection — just describe what you want to interact with in natural language.