Integrate with Mantis - Report Bugs Effortlessly

Running tests ensures thorough execution and accurate tracking of your system's quality. Use this guide to effectively execute test cases, log results, and analyze outcomes.

Learn what is a Test Run here.

‍

1. Run Tests Using the Checklist

• Use the Test Cases List in the Test Run for quick execution:
  • Quick Pass: Click the ‘Quick Pass’ button to mark a test case as Passed.‍
  • Change Status: Use the dropdown menu to set the test case status to:‍
    • Not Tested (default).‍
    • Passed.‍
    • Failed.‍
    • Blocked

• For Failed or Blocked Tests:
  • A modal window appears when setting a test case to Failed or Blocked.
  • In the modal, you can:
    • Add comments for additional context.
    • Attach files such as screenshots or logs.
    • Report a Bug:
      • Automatically via integrated tools
      • Manually by adding a bug link.

Read more about Integrations here.

‍

2. Run Tests in the Test Case Detail

• Open Test Case Details to execute tests step-by-step:
  • Set individual step results as you work through the test case.
  • If any step is marked as Failed or Blocked, the system automatically updates the entire test case status accordingly.
  • Add comments, attachments, or report bugs directly within the details view

• Use the ‘Next’ button to move to the next Not Tested test case.

‍

3. Completing the Test Run

Once all test cases are executed, the Test Run status updates to Completed.

‍

4. View Test Run Reports

• After completion, a detailed Test Run Report is generated, including:
  • A summary of results (e.g., passed, failed, blocked cases).
  • Logs for each test case.
• Use the report to:
  • Analyze results.
  • Compare outcomes across up to 4 Test Runs to track progress and identify trends.

Read more about Reports here.

‍

What’s Next?

Running tests in TestCaseLab ensures accurate tracking and documentation of your testing process. For further assistance, check related guides or contact support—we’re here to help!

‍

Create a Test Run

Creating a Test Run helps organize and execute a specific set of test cases to meet your testing objectives. Follow this guide to set up a Test Run efficiently.

Learn what is a Test Run here.

‍

1. Create from the Test Plan’s Page

• Navigate to the Test Plan’s page and select the Test Plan you want to use.
• Click the ‘Create Test Run’ button.
• The Test Run will automatically include the test cases from the selected Test Plan, arranged in the same order defined in the plan’s Checklist.

‍

2. Create from the Test Runs Page

• Go to the Test Runs page.
• Click the ‘+ Test Run’ button to open the creation form.
• Fill out the following details:
  • Title: Enter a unique name for the Test Run.
  • Test Plans: Select one or more Test Plans to base the Test Run on.
  • Assignees: Choose the users responsible for executing the Test Run.

Note: Skip the ‘Test Plans’ field if you prefer to manually add test cases.

3. Manually Include Test Cases

If you skipped the Test Plans field during creation:

• Open the Test Run’s inner page.
• Click ‘Edit Run’ to access the test case selection interface.
• Use the checkboxes to select the test cases you want to include in the Test Run.

‍

4. Start Running

Once the Test Run is prepared and all desired test cases are included, start the execution process.

Learn more about running Test Runs here.

‍

Manage a Test Run

Managing a Test Run ensures your testing process stays organized and adaptable to your needs. Follow this guide to work efficiently with Test Runs.

‍

1. Test Run View Modes

Test cases in a Test Run can be displayed in two modes:

• Grouped-by-Suite View Mode:
  • Default view, grouping test cases by Suites.
  • Sorting is inherited from the Test Cases page and can only be updated by Project Administrators.

• Checklist View Mode:
  • Displays a flat list of test cases.
  • Test cases can be rearranged using drag&drop by any Project Member.
  • Ideal for customizing the order for convenient testing workflows

‍

2. Rearranging Test Cases

• Checklist View Mode:
  • Use drag-and-drop to reorder test cases for your preferred testing sequence.

Note: Changes in Checklist View Mode do not affect the order in the Grouped-by-Suite View Mode.

• Test Runs Created from Test Plans:
  • If the Test Run is based on a Test Plan, the test case order from the Test Plan is applied.

Note: Any changes made in the Test Run will not affect the Test Plan’s original order.

‍

3. Edit a Test Run

Use the ‘Edit Run’ modal to update Test Run details:

• Title: Modify the Test Run name.
• Assignees: Add or change the testers assigned to the Test Run.
• Include/Exclude Test Cases: Adjust the list of test cases in the Test Run.

Note: Newly added test cases in Checklist View Mode will appear at the bottom of the list.

‍

What’s Next?

Managing Test Runs effectively ensures smooth execution and adaptability for testing needs. For additional help, check related guides or contact support—we’re here to help!

‍

Test Runs are one-time executions of test cases designed to validate functionality and quality.

Managing Test Runs helps streamline test execution and keep track of testing progress and results. Use the following guide to effectively organize and manage your Test Runs.

Learn what is a Test Run here.

‍

1. Create a Test Run

• Go to the Test Runs page.
• Click the ‘+ Test Run’ button to add a new Test Run.

Note: Test Runs can be created either based on pre-created Test Plans or by adding test cases directly into an empty Test Run.

Learn more about creating a Test Run here.

2. Sort Test Runs

Sort Test Runs by Name for better organization.

‍

3. Filter Test Runs

Apply filters to focus on specific Test Runs based on:

• Status: Filter by Not Started, In Progress, or Completed Test Runs.‍
• Assigned to You: View Test Runs where you are the assigned tester.‍
• Cases Within Runs Assigned to You: Focus on specific test cases assigned to you within a Test Run.

‍

4. Manage Test Runs

• Duplicate: Create a copy of an existing Test Run for reuse.‍
• Archive and Restore:‍
  • Archive Test Runs to temporarily remove them from active use.
  • Restore archived Test Runs when needed.‍
• Delete: Permanently delete Test Runs that are no longer required.

Note: Deleted Test Runs cannot be restored.

‍

5. Export Test Run Reports

Generate and export reports from completed Test Runs in the following formats:

• CSV
• PDF
• Online View

Learn more about reports here.

‍

6. Switch Test Runs List View Modes

• Line View: A standard list format for Test Runs.

• Grid View: Displays pie charts for visual tracking of progress and completion status.

‍

What’s Next?

Efficiently managing Test Runs ensures a smooth testing workflow and accurate reporting of results. For additional help, check related guides or contact support—we’re happy to assist!

‍