Test Suite Runs page

Test Suite Runs page shows the test suites that were run in period defined in Running Date filter and looks:

ts runs

The following actions are available on this page:

  1. Viewing test suite details: click on Test Suite and it opens Test Suite page.

  2. Testing results comparison and reports building clicking on check button.

    The option reprocesses comparison and report generation asynchronously. It makes sense to execute the option once you have configured a new "ignore rule".

  3. Remote results polling. Select unfinished test suite run(s) and click on Poll remote results button.

    Since Figaf Tool 2.15 automatic polling is added for SAP CPI Agents. Once the messages have been run successfully, automatic polling is started.

    Since Figaf Tool 2.15.2 active polling statistics can be viewed. If there is polling in progress for the integration objects and you open another poll remote data dialog, then

    • recordings/test runs which are in both polling requests will be marked as SKIPPED_AS_DUPLICATE and statistics will be copied from original item and shown on UI in the new one.

    • recordings/test runs which are not in the original polling request will be SKIPPED in the new one.

    Since Figaf Tool 2305 polling will not be started if there is already a started polling requests with same objects in progress or polling has been already completed for all selected objects.

    If you have polled almost all messages and you just need to poll small number of messages to finish testing, you can enable option Ignore messages cache during polling on Application configuration page. When this option is enabled, already polled messages won’t be skipped. It affects performance when the amount of messages is large and you just need to poll small number to finish testing.

  4. Downloading consolidated diff report for test suite runs. Select test suite run(s) and click on Diff report button. It will take diff info from all related test runs/test run results with ERROR status and build CSV file (semicolon as a separator) with the following information:

    consolidated diff report

    Combination of fields Message, Partner, Diff State, Old Value, New Value organize a unique key, Affected Test Suites and Affected Messages count are aggregated. Affected Messages count - is count of failed test run results (outbound messages) which contain the error determined by the key. Obviously, if some error occurred in one message several times, that message will be counted only once.

    Correlation between old and new value for now properly added only for EDI types (EDIFACT and X12).

  5. Export as a test case to PIT.

  6. Deleting selected testing results.

  7. Downloading report.

    Report type can be one of 2 types:

    1. xlsx report:

      • Contains information about test run/test suite run results.

      • By default only failed results are added to xlsx report. If you want to change this behavior, go to Configuration → Application page and enable Show successful messages in the test suite’s report property.

    2. zip archive with 3 csv reports:

      • test-run-metadata.csv - contains common information about test run/test suite run (e.g. test object, counters for success/error/unexpected/not/compared/unfinished test run/test suite run results).

      • diff-report.csv - contains diff report for test run/test suite run.

      • processed-messages-report.csv - contains processed messages report for test run/test suite run.

    The report type is defined from Use bundled CSV report generation strategy property configured on Application configuration page. If it’s true, the report type is zip, otherwise, it’s xlsx.

  8. Viewing Test Suite Run details clicking on details. It opens Test Suite Run page.