drone-testng

Building

Build the plugin binary:

scripts/build.sh

Build the plugin image:

docker build -t plugins/testng -f docker/Dockerfile .

Testing

Execute the plugin from your current working directory:

TestNG: This plugin process the TestNG report files and log the Test Reports in the console.

docker run --rm \
  -e PLUGIN_REPORT_FILENAME_PATTERN="**/target/testng-results.xml" \
  -e PLUGIN_FAILED_FAILS=5 \
  -e PLUGIN_FAILED_SKIPS=3 \
  -e PLUGIN_THRESHOLD_MODE=1 \
  -e PLUGIN_FAILURE_ON_FAILED_TEST_CONFIG=true \
  -e PLUGIN_PLUGIN_FAIL_IF_NO_RESULTS=true \
  -v $(pwd):$(pwd) \
  plugins/testng

Example Harness Step:

- step:
    identifier: testngtojunitconversion
    name: TestNG
    spec:
      image: plugins/testng
      settings:
        report_filename_pattern: "**/target/testng-results.xml"
        failed_fails: 5
        failed_skips: 3
        threshold_mode: 1
        failure_on_failed_test_config: true
        fail_if_no_results: true
    timeout: ''
    type: Plugin

Plugin Settings

• PLUGIN_REPORT_FILENAME_PATTERN Description: The file name pattern to locate TestNG XML report files. Supports Ant-style patterns. Example: **/target/testng-results.xml

• PLUGIN_FAILED_FAILS Description: Maximum number of failed tests before the build is marked as FAILURE. Example: 5

• PLUGIN_FAILED_SKIPS Description: Maximum number of skipped tests before the build is marked as FAILURE. Example: 3

• PLUGIN_THRESHOLD_MODE: (Optional) Specifies the mode for threshold validation:

  • absolute: In this mode, the thresholds are validated against specific counts of failed and skipped tests.
  • percentage: In this mode, the thresholds are validated against percentage values of failed and skipped tests relative to the total tests executed.
  • Example:

  - step:
    identifier: testng80776e
    type: Plugin
    name: testng
    spec:
      connectorRef: nunitdockerconnector
      image: mamid1b/testng
      settings:
        failed_fails: "10"                     # Threshold for failure rate in percentage
        failed_skips: "100"                    # Threshold for skip rate in percentage
        failure_on_failed_test_config: "false"
        level: info
        report_filename_pattern: ./testng-report.xml
        threshold_mode: percentage
  

  • The configured failure threshold is 10%, and the actual failure rate (28.57%) exceeds this limit.
  • Since the threshold_mode is percentage, the plugin fails based on the percentage validation.
  • Default: absolute.

• PLUGIN_FAILURE_ON_FAILED_TEST_CONFIG Description: If true, the build will fail if any configuration method (e.g., @BeforeSuite, @AfterTest) fails. Example: true

• LOG_LEVEL debug/info Level defines the plugin log level. Set this to debug to see the response from NUnit