Endtest

Endtest

›Advanced

Web Tests

  • How to create Web Tests
  • Finding elements in Web Applications
  • How to execute Web Tests
  • Assertions for Web Tests
  • IF Statements for Web Tests
  • Web Applications with restricted access
  • How to test in iframes
  • How to test in multiple tabs
  • How to test File Uploads
  • How to test File Downloads
  • How to test Emails
  • How to test PDF files
  • How to test Chrome Extensions
  • Dealing with reCAPTCHA
  • Dealing with Dynamic Locators
  • Dealing with Canvas Elements
  • Performing a Drag and Drop
  • Execute JavaScript
  • Modify HTTP Headers
  • Testing WebRTC Applications
  • How to scroll in Web Tests
  • How to test Checkboxes
  • How to test Dropdowns
  • Dealing with Sessions
  • Web Crawler
  • Export Web Tests
  • Migrating from Selenium

Mobile Tests

  • How to create Mobile Tests
  • Finding elements in Mobile Applications
  • How to execute Mobile Tests
  • Assertions for Mobile Tests
  • IF Statements for Mobile Tests
  • How to scroll in Mobile Tests
  • Performing Complex Gestures

Advanced

  • Variables
  • Waits
  • Endtest API
  • Scheduler
  • Drive
  • Adding Collaborators
  • AI Assertions
  • AI Variables
  • Computer Vision
  • Importing Test Cases
  • Using Loops
  • Data-driven Testing
  • Send API Requests
  • Read SMS
  • Execute SQL queries
  • Self-Healing Tests
  • Email Notifications
  • Slack Notifications
  • PagerDuty Notifications
  • Webhook Notifications
  • Automatic Backup
  • Advanced Settings
  • Multiple environments
  • How to stop a test
  • Utilities
  • Utilities API
  • Team
  • On-Premises

Integrations

  • Atlassian Jira
  • Slack
  • PagerDuty
  • Microsoft Teams
  • Discord
  • Mattermost
  • Jenkins
  • GitHub
  • Azure DevOps
  • GitLab
  • TeamCity
  • CircleCI
  • TravisCI
  • Bitbucket
  • Heroku
  • Bamboo Server
  • Test Case Management
  • SSO
  • BrowserStack
  • Sauce Labs

AI Variables

Overview

AI Variables can be generated using the Use AI option within the Set Variable action.

They allow you to generate, extract, and transform data using natural language, without writing custom scripts or complex parsing logic.

AI Variables are especially useful when the data:

  • Is dynamic or context-dependent
  • Requires reasoning or aggregation
  • Is difficult to extract reliably using a single locator

endtest ai variables web page


Scope Options

The Scope defines where the AI gets its information from.
Only one scope can be selected per AI Variable.


Web Tests

1. General Knowledge

Uses general, real-world knowledge and does not depend on the application under test.

Example prompts:

  • Generate a random fictional mobile phone number from Sweden
  • Generate a valid IBAN for Germany

2. Web Page

When Web Page is selected, the AI processes:

  • The current URL
  • The page source
  • A screenshot of the page

Example prompts:

  • Calculate the total value by adding up all the prices from the "Price" column from the table
  • Identify the primary currency used on the page
  • Extract the value represented by the largest segment of the pie chart

3. Cookies

Extracts values from browser cookies.

Example prompts:

  • Extract the value of the cookie that contains the user session information
  • Get the value of the HubSpot tracking cookie

4. Variables

Allows the AI to read, combine, and transform existing variables.

Example prompts:

  • Add up all the numerical values from the variables that contain the prices of the products
  • Extract the customer ID from the nested JSON stored in the $responseBody variable
  • Calculate the number of days between the start date and end date variables

5. Test Execution Logs

Allows the AI to analyze execution logs and derive values.

Example prompts:

  • Get the number of total Click steps executed so far
  • Extract the latest URL that was accessed in this test execution

Mobile Tests

For Mobile Tests, web-specific scopes are replaced with App Screen.

1. App Screen

When App Screen is selected, the AI processes:

  • The app screen source
  • A screenshot of the current screen

Example prompts:

  • Extract the option that is visually marked as recommended
  • Get the name of the largest city shown on the map
  • Extract the name of the main shopping category shown on the screen

Strictness Levels

When generating or extracting AI Variables, you can control how strict the AI should be.

  1. Strict
    Precise extraction. Fails if the value is unclear or ambiguous.

  2. Standard
    Balanced interpretation.
    Recommended for most use cases.

  3. Lenient
    Tolerant of ambiguity, formatting differences, or partial matches.


Best Practices

  • Be explicit about what value you want to generate or extract.
  • Use General Knowledge only when the value does not depend on the application.
  • Prefer Standard strictness for most variables.
  • Use Strict strictness for values that affect critical test logic.

← AI AssertionsComputer Vision →
  • Overview
  • Scope Options
    • Web Tests
    • Mobile Tests
  • Strictness Levels
  • Best Practices
© Endtest Inc.