Test Execution Reference

Complete reference for running tests — environments, modes, scheduling, monitoring, results, retries, and parallel execution

Complete reference for executing tests in SmoothDeploy: local vs remote environments, single/batch/scheduled execution, real-time monitoring, result artifacts, retry strategies, and parallel execution. New to SmoothDeploy? Start with Running Your First Test.

Execution Environments

Local Execution

Run tests on your development machine using the Tauri native app.

Benefits:

Full control over execution environment
Fast feedback during development
Easy debugging and troubleshooting
No network dependencies

Use Cases:

Development and debugging
Quick validation
Personal testing
Offline execution

Requirements:

Tauri native app installed
Local browser (Chrome, Firefox, Safari)
Sufficient system resources

Remote Execution (Coming Soon)

Execute tests in cloud-based infrastructure for scalability.

Benefits:

Parallel execution capabilities
Consistent environment
Comprehensive reporting
Resource optimization

Use Cases:

CI/CD integration
Large test suites
Cross-browser testing
Performance testing

Execution Configuration

Test Configuration

Configure execution settings at multiple levels:

Organization Level:

Default execution environment
Resource limits
Security policies
License constraints

Project Level:

Environment variables
Browser settings
Timeout configurations
Parallel execution rules

Test Level:

Specific parameters
Custom configurations
Override settings
Execution conditions

Playwright Configuration

Customize browser behavior and test execution:

{
  "browser": "chromium",
  "headless": false,
  "viewport": { "width": 1280, "height": 720 },
  "timeout": 30000,
  "retries": 2,
  "workers": 4
}

Environment Variables

Manage test data and configuration:

System Variables:

Browser settings
Timeout values
Retry counts
Screenshot options

Test Variables:

User credentials
API endpoints
Test data
Environment-specific values

Secret Variables:

Passwords
API keys
Database credentials
Third-party tokens

Execution Modes

Single Test Execution

Run individual tests for development and debugging.

Process:

Select test to execute
Configure execution parameters
Choose execution environment
Monitor execution progress
Review results and artifacts

Batch Execution

Execute multiple tests in sequence or parallel.

Sequential Mode:

Tests run one after another
Shared browser session
Faster startup time
Resource efficient

Parallel Mode:

Tests run simultaneously
Independent browser sessions
Faster overall execution
Higher resource usage

Scheduled Execution

Automated test execution based on schedules.

Schedule Types:

Time-based: Daily, weekly, monthly
Event-based: Code commits, deployments
Conditional: Based on triggers
Manual: On-demand execution

Execution Monitoring

Real-time Monitoring

Track test execution progress in real-time:

Progress Indicators:

Current step being executed
Overall progress percentage
Estimated completion time
Resource utilization

Live Updates:

Step-by-step execution
Screenshot captures
Error notifications
Performance metrics

Execution Logs

Comprehensive logging for debugging and analysis:

Log Levels:

Debug: Detailed execution information
Info: General execution status
Warn: Non-critical issues
Error: Execution failures

Log Types:

Browser console logs
Network requests
Step execution details
Error stack traces

Results and Reporting

Execution Results

Comprehensive results for each test execution:

Status Information:

Passed: All assertions successful
Failed: One or more failures
Skipped: Test not executed
Cancelled: Execution stopped
Timeout: Execution exceeded time limit

Performance Metrics:

Execution duration
Step timing
Resource usage
Network performance

Artifacts:

Screenshots
Video recordings
Network traces
Console logs
Error reports

Test History

Track test execution over time:

Historical Data:

Execution frequency
Success/failure rates
Performance trends
Flakiness analysis

Trend Analysis:

Stability improvements
Performance degradation
Failure patterns
Success metrics

Advanced Features

Conditional Execution

Execute tests based on specific conditions:

Environment Conditions:

Browser type
Operating system
Test data availability
System requirements

Data Conditions:

Test data presence
Variable values
Previous test results
External dependencies

Parallel Execution

Run multiple tests simultaneously:

Configuration:

Worker count
Resource allocation
Test distribution
Result aggregation

Optimization:

Test isolation
Resource management
Load balancing
Performance tuning

Retry Logic

Automatic retry for failed tests:

Retry Strategies:

Fixed: Same number of retries
Exponential: Increasing retry intervals
Conditional: Retry based on failure type
Smart: Learn from failure patterns

Troubleshooting

Common Issues

Execution Failures:

Check test configuration
Verify environment setup
Review error logs
Test individual steps

Performance Issues:

Optimize test execution
Reduce resource usage
Improve step efficiency
Consider parallel execution

Environment Problems:

Verify browser installation
Check system requirements
Update dependencies
Review permissions

Debugging Techniques

Step-by-step Execution:

Run individual steps
Add debug assertions
Capture intermediate states
Review execution logs

Isolation Testing:

Test in clean environment
Remove external dependencies
Simplify test scenarios
Validate assumptions

On this page