Version 2.4.0 (May 2026)
Release Date: 11.05.2026
New Features
- Timeout Status A new Timeout status has been introduced to provide clearer visibility into scenarios that exceed their maximum execution time. Scenarios that do not complete within the defined Max Execution Time will now be marked with this status, helping you easily distinguish them from standard failures or errors. This improves result analysis and makes it easier to identify performance bottlenecks or long-running scenarios that require attention.
Improvements
- Total Test Run Minutes Displayed on the Dashboard The Total Test Run Minutes information is now displayed under the Pie Chart on the Dashboard. The value is updated based on the selected chart period, ensuring that users can view the total test run minutes for the same time range reflected in the chart.
- Previous Results Behavior Update The “Previous Results” tab within a scenario report for Appium 2 and Selenium 4 executions has been aligned with the behavior of Appium 1 and Selenium 3. Previous results are now filtered to show only executions of the same scenario under matching environment conditions. This includes the same operating system, browser, and device configuration. This update ensures that comparisons are made against truly equivalent runs, improving the accuracy and relevance of historical result analysis.
- Clear App Data Support for Appium 2 Appium 2 now supports the ability to clear application data during test execution. This allows tests to start with a clean application state without requiring a full uninstall. It is particularly useful for resetting user sessions, cached data, and app-specific settings between scenario runs, leading to more controlled and reliable test behavior. This behavior is not supported on public devices, as applications are always uninstalled after execution This feature requires testinium-appium2-driver version 1.0.1 or higher.
- "ResultDetails" Sheet Added to Excel Reports A new third sheet named ResultDetails has been added to Excel Report outputs for all test types (previously it was only for Appium1). This sheet provides a more detailed view of the relationship between each Test Scenario and its related Environment. It also includes additional execution details such as ID, Status, Run Time, and Message, making Excel reports more useful for result analysis.
- OS Version Displayed in Appium 2 Test Reports The phone’s OS Version is now displayed in Appium 2 test execution reports. Previously, the OS version information was not visible in the report. With this improvement, users can now see the related device OS version directly within Appium 2 test results, making environment details clearer and easier to analyze.
Bug Fixes
- Export Excel Issue Fixed for Selenium 3 and Appium 1 Reports An issue where the Export Excel action failed with a 500 error for Selenium 3 and Appium 1 reports has been fixed. Users can now successfully export Excel reports for Selenium 3 and Appium 1 test executions.
- Video Playback Issue Fixed for Cloud Device Farm Executions An issue where execution videos could not be played for tests sent to the cloud device farm has been fixed. Previously, users could receive an Unsupported error when trying to watch execution videos due to the video file extension. These videos can now be viewed properly in test execution reports.
- Active Tests Refresh Issue Fixed An issue where refreshing the Active Tests page caused a 500 error has been fixed.
- Project ID Missing for Selenium Web Projects in Projects API Response An issue where the Project ID was not returned for Selenium Web projects when listing active projects through the /Testinium.RestApi/api/projects/ API has been fixed.
- Uninstall Application "No" Setting Fixed An issue where the application could still be removed even when Uninstall Application was set to “No” has been resolved. The setting is now correctly enforced on private device executions, ensuring the application remains installed and its state is preserved between scenarios. This behavior is not supported on public devices. This feature requires testinium-appium2-driver version 1.0.1 or higher.
- Scenario-Level "System Parameters" Now Work Correctly An issue where System Parameters added at the scenario level were not being applied during test execution has been resolved. Scenario-level parameters are now correctly passed to the execution environment, allowing scenario-specific values to be used as expected.
- "System Parameters" Issue Fixed for Selenium 4 Plans An issue where System Parameters were not saved or displayed correctly in Selenium 4 Plans has been fixed.