- collaboration
- Invite Team Members
- Assign Projects
- Users & Role Management
- Review Management [Test Cases]
- Review Management [Elements]
- Execution Controls
- Manage Test Cases
- Test Case List Actions
- Import and Export Test Cases
- Import Test Project Test Cases
- Importing Postman Collections and Environments
- Update Test Case result in a Test Plan
- Test Cases (Mobile Web App)
- Test Step Types
- Type: Natural Language
- Type: REST API
- Type: Step Group
- Type: For Loop
- Type: While Loop
- Type: Block
- Type: If Condition
- Nested Step Groups
- Image Injection
- Cross-application testing
- Test Data Types
- Raw
- Parameter
- Runtime
- Random
- Data Generator
- Phone Number
- Mail Box
- Environment
- Concat Test Data
- Create Test Data [Parameter]
- Update Test Data Profile
- Updating Value in TDP
- Import TDP
- Bulk Deletion of a Test Data Profile
- Create Test Data [Environment]
- Elements (Objects)
- Web Applications
- Record Single Element
- Record Multiple Elements
- Create Elements
- Supported Locator Types
- Formulating Elements
- Shadow DOM Elements
- Verifying elements in Chrome DevTools
- Handling iframe Elements?
- Dynamic Locators using Parameter
- Dynamic Locators using Runtime
- Using Environment Test Data for Dynamic Locators
- Locating Dynamic Elements in Date Widget
- Freeze & Inspect Dynamic Elements (WebPage)
- Locating Dynamic Elements in Tables
- Import/Export Elements
- AI Enabled Auto-Healing
- Locator Precedence (Web Apps)
- Verify Elements from Test Recorder
- test step recorder
- Install Chrome Extension
- Install Firefox Extension
- Install Edge Extension
- Exclude Attributes/Classes
- test plans
- Add, Edit, Delete Test Machines
- Add, Edit, Delete Test Suites
- Schedule Test Plans
- Run Test Suites In Parallel
- Cross Browser Testing
- Distributed Testing
- Headless Testing
- Test Lab Types
- Disabling Test Cases in Test Plans
- AfterTest Case
- Post Plan Hook
- AfterTest Suite
- Email Configuration in Test Plan
- Execute Partial Test Plans via API
- Ad-hoc Run
- Test Plan Executions
- Dry Runs on Local Devices
- Run Tests on Private Grid
- Run Tests on Vendor Platforms
- Run Test Plans on Local Devices
- Test Locally Hosted Applications
- Debug Test Case Failures
- Parallel and Allowed queues
- debugging
- Debug results on local devices (Web applications)
- Debug Results on Local Devices
- Launch Debugger in the Same Window
- Testsigma Agent
- Pre-requisites
- Setup: Windows, Mac, Linux
- Setup: Android Local Devices
- Setting up iOS Local Devices
- Update Agent Manually
- Update Drivers Manually
- Delete Corrupted Agent
- Delete Agents: Soft & Permanent
- Triggering Tests on Local Devices
- troubleshooting
- Agent - Startup and Registration Errors
- Agent Logs
- Upgrade Testsigma Agent Automatically
- Specify Max Sessions for Agents
- Testsigma Agent - FAQs
- continuous integration
- Test Plan Details
- REST API (Generic)
- Jenkins
- Azure DevOps
- AWS DevOps
- AWS Lambda
- Circle CI
- Bamboo CI
- Travis CI
- CodeShip CI
- Shell Script(Generic)
- Bitrise CI
- GitHub CICD
- Bitbucket CICD
- GitLab CI/CD
- desired capabilities
- Most Common Desired Capabilities
- Browser Console Debug Logs
- Geolocation Emulation
- Bypass Unsafe Download Prompt
- Geolocation for Chrome & Firefox
- Custom User Profile in Chrome
- Emulate Mobile Devices (Chrome)
- Add Chrome Extension
- Network Throttling
- Network Logs
- Biometric Authentication
- Enable App Resigning in iOS
- Enable Capturing Screenshots (Android & iOS)
- Configure Android WebViews
- Incognito/Private mode
- Set Google Play Store Credentials
- addons
- What is an Addon?
- Addons Community Marketplace
- Install Community Addon
- Prerequisites(Create/Update Addon)
- Create an Addon
- Update Addon
- Addon Types
- Create a Post Plan Hook add-on in Testsigma
- Create OCR Text Extraction Addon
- configuration
- API Keys
- Security(SSO)
- Setting Up Google Single Sign-On(SSO) Login in Testsigma
- Setting Up Okta Single Sign-On Integration with SAML Login in Testsigma
- Setting up SAML-based SSO login for Testsigma in Azure
- iOS Settings
- Creating WDA File for iOS App Testing
- uploads
- Upload Files
- Upload Android and iOS Apps
- How to generate mobile builds for Android/iOS applications?
- Testsigma REST APIs
- Environments
- Elements
- Test Plans
- Upload Files
- Get Project Wide Information
- Upload & Update Test Data Profile
- Fetch Test Results (All Levels)
- Trigger Multiple Test Plans
- Trigger Test Plans Remotely & Wait Until Completion
- Run the Same Test Plan Multiple Times in Parallel
- Schedule, Update & Delete a Test Plan Using API
- Update Test Case Results Using API
- Create and update values of Test Data Profile using REST API
- Rerun Test Cases from Run Results using API
- open source dev environment setup
- macOS and IntelliJ Community Edition
- macOS and IntelliJ Ultimate Edition
- Windows and IntelliJ Ultimate Edition
- Setup Dev Environment [Addons]
- NLPs
- Retrieve Value in Text Element
- Capture Dropdown Elements
- Unable to Select Radiobutton
- Unable to Click Checkbox
- Clearing the Session or Cookies
- UI Identifier NLP
- Drag & Drop NLP
- Uploading Files NLP
- setup
- Server Docker Deployment Errors
- Secured Business Application Support
- Troubleshooting Restricted Access to Testsigma
- Why mobile device not displayed in Testsigma Mobile Test Recorder?
- Unable to Create New Test Session
- Agent Startup Failure Due to Used Ports
- Tests Permanently Queued in Local Executions
- Fix Testsigma Agent Registration Failures
- Testsigma Agent Cleanup
- Need of Apache Tomcat for Testsigma Agent
- web apps
- URL not accessible
- Test Queued for a Long Time
- Issues with UI Identifiers
- Missing Elements in Recorder
- Collecting HAR File
- Errors with Browser Session
- Page Loading Issues
- mobile apps
- Failed to Start Mobile Test Recorder
- Troubleshooting “Failed to perform action Mobile Test Recorder” error
- Test Execution State is Queued for a Long Time
- Mobile app keeps stopping after successful launch
- More pre-requisite settings
- Unable to start WDA Process on iPhone
- Most Common causes for Click/Tap NLP failure
- Finding App Package & App Activity (Android)
- Cross-environment Compatible ID Locators (Android)
- Why Accessibility IDs Over other Locators?
- Common Android Issues & Proposed Solutions
- Finding the App Bundle ID for iOS
- on premise setup
- On-Premise Setup Prerequisites
- On-Premise Setup with Docker-compose File
- Post-Installation Checklist for On-Premise Setup
- Install Docker on an Unix OS in Azure Infrastructure
- SMTP Configuration in Testsigma
- Configure Custom Domains
- salesforce testing
- Intro: Testsigma for Salesforce Testing
- Creating a Connected App
- Creating a Salesforce Project
- Creating Metadata Connections
- Adding User Connections
- Build Test Cases: Manual+Live
- Salesforce Element Repositories
- Intro: Testsigma Special NLPs
- Error Handling On Metadata Refresh
- Automating Listview Table NLPs
- windows automation
- Intro: Windows Desktop Automation
- Windows (Adv) Project & Application
- Object Learning (Using UFT One)
- Converting TSR Files to TSRx
- Importing/Updating TSRx Files
- Test Cases for Windows Automation
- Error Handling Post TSRx File Update
Testsigma Setup using Bundled Package
Prerequisites
Create a folder called testsigma where you would like to install Testsigma.
cd cmd into this installation folder(testsigma)
Step 1: Download the Package
Download the Testsigma zip into the installation folder(testsigma) from https://github.com/testsigmahq/testsigma/releases/latest/
You will find the following files in this location, download the appropriate one based on your OS.
- Testsigma-Windows-{latest-version}.zip
- Testsigma-Mac-{latest-version}.zip
- Testsigma-Linux-{latest-version}.zip
Once the file is downloaded, extract it to the directory you wish and follow the steps below: We need 4 components for the Testsigma community server to work:
- MySQL (not bundled)
- Nginx (bundled)
- Testsigma Server (bundled)
- Testsigma Agent (bundled)
MySQL
Install MySQL
- Download and install MySQL from https://dev.mysql.com/downloads/mysql/
- Set the MySQL password for the root user as root. You can choose to set a different password, but while starting the testsigma API server you will need to set this as an environment variable (MYSQL_PASSWORD).
Connect with Existing MYSQL
You can also connect with an external/existing MYSQL server instance. Set the following environment variables to connect with the existing MYSQL Instance
MYSQL_HOST_NAME = <mysql_host_name> where mysql_host_name is your database url
MYSQL_PORT = < port_number> where mysql is running
MYSQL_DB_NAME = <db_name> where you want to save data
MYSQL_USER = < username>
MYSQL_PASSWORD = < password>
Nginx
Since we have UI components and API server separately we need a single application to route the requests between them. Nginx is the one that facilitates this. Nginx listens to 443 ports for HTTPS connections and forwards them to the API server, so make sure this port is not occupied by another service.
Testsigma Server
Testsigma follows API first approach, all APIs are served from this service. This service contains all APIs and business logic to support the Testsigma UI and all other backend processes. Testsigma Server is a Spring Boot application that runs on port 9090 by default. Make sure that 9090 is free. If you want to change the port follow the steps below.
- Before changing the ports, stop Nginx, Testsigma Server and Testsigma Agent.
- Navigate to the Nginx folder from the downloaded Testsigma zip and open nginx.conf. In the text http://localhost:9090 replace the port you would like to use and save it.
- Before starting the Testsigma server set the environment variable TESTSIGMA_SERVER_PORT to the port you want
- Before starting the Testsigma agent, set the environment variable LOCAL_SERVER_URL to http://localhost:
here you can replace with the port you would like to use.
Testsigma Agent
Testsigma Agent is a microservice that processes test case data and runs tests on browsers and mobile devices. The Testsigma agent runs on ports 9393 (HTTP) and 9494 (HTTPS) by default. If you want to change these ports, follow the steps below:
- Before changing the ports, stop Nginx, Testsigma Server, and Testsigma Agent.
- Before starting the Testsigma server you need to set the environment variable LOCAL_AGENT_URL= https://localhost:<http_port>, here you can replace the <http_port> with the port you want to use for the agent.
- Before starting the Testsigma agent you need to set the environment variables TESTSIGMA_AGENT_HTTP_PORT for HTTP port and TESTSIGMA_AGENT_HTTPS_PORT for HTTPS port.
Step 2: Run Services
Windows
Starting Nginx:
- Open a command prompt
- Navigate to the extracted folder
- Run start_nginx.bat to start Nginx
- If you want to stop nginx at any point in time then, run the start_nginx.bat script
Starting API Server:
- Open a command prompt
- Navigate to the extracted folder
- Navigate to the TestsigmaServer folder
- Run start.bat file to start the Testsigma API server
- You can run stop.bat if you want to stop the API server at any point in time
Starting Local Agent:
- Open a command prompt
- Navigate to the extracted folder
- Navigate to the TestsigmaAgent folder
- Run start.bat file to start the Testsigma Agent
- You can run stop.bat if you want to stop the agent at any point in time
Mac / Linux:
Starting Nginx:
- Open a command prompt
- Navigate to the extracted folder
- Run start_nginx.sh file to start the Nginx
- You can run stop_nginx.sh if you want to stop the nginx at any point in time
Starting API Server:
- Open a command prompt
- Navigate to the extracted folder
- Navigate to the TestsigmaServer folder
- Run start.sh file to start the Testsigma API server
- You can run stop.sh if you want to stop the API server at any point in time
Starting Local Agent:
- Open a command prompt
- Navigate to the extracted folder
- Navigate to the TestsigmaAgent folder
- Run start.sh file to start the Testsigma API agent
- You can run stop.sh if you want to stop the agent at any point in time
Verifying the installation
Your Testsigma server should be up and running now. Testsigma server will be accessible at https://local.testsigmaos.com/ui
Update to new Version
- Stop Nginx, TestsigmaServer, TestsigmaAgent
- Delete the Testsigma Installation folder
- Download the latest version from here https://github.com/testsigmahq/testsigma/releases/latest/
- Repeat the steps explained in “Step2: Run Services” section
- Now login to check the updated version of Testsigma Server here https://local.testsigmaos.com/ui
Troubleshooting
If you encounter any errors during this process, check out our guide on debugging deployment errors. If you are still facing any issue, please reach out to support@testsigma.com or join our Discord Server to speak to the Testsigma team directly!
Next Steps
- Get Started with Automating Web Applications
- Get Started with Automating Mobile Web Applications
- Get Started with Automating Android Apps
- Get Started with Automating iOS Apps
- How to automate tests for Android Apps using local devices
- How to automate tests for iOS Apps using local devices