alma.acs.testsupport.tat

Class TATJUnitRunner

java.lang.Object

alma.acs.testsupport.tat.TATJUnitRunner

public class TATJUnitRunner
extends java.lang.Object

Replacement for a standard JUnit runner such as JUnit3's junit.textui.TestRunner, or JUnit4's JUnitCore, which helps avoid some issues with using JUnit embedded in ALMA TAT scripts.

Note that the intent is not to get rid of the output-based testing that TAT offers, but to complement it with result-based testing as JUnit proposes it, and to make the latter easier in a TAT environment. Both approaches have their merit, so chose one depending on what you want to test.

TATJUnitRunner internally calls JUnitCore#run(Class...), controlling the RunListener output as well as System.out and System.err.

This class fixes the following issues

1. If the tests succeed, JUnitCore produces too much output, leading to unnecessary maintenance work.
   TATJUnitRunner produces only very simple fixed output for successful tests, which means it suppresses
   • JUnitCore output
   • any other output to System.out
   • any other output to System.err
   Instead, it prints 2 fixed lines, as required by TAT / NRI for gathering test statistics. Both JUnitCore and TATJUnitRunner return an exit code 0 to indicate a successful run.
2. If a test fails (JUnit3: either "failure" or "error"), TestRunner reports this in the execution summary, without giving enough details on the problem, e.g. the assertion that caused the failure.
   TATJUnitRunner in this case becomes rather verbose and dumps on System.err
   • the detailed test runner output.
   • any output to System.out during test execution
   • any output to System.err during test execution
   Both JUnitCore and TATJUnitRunner return an exit code 1 for a failure.

For either failure or success, the following line is printed as the first line to stdout, so that TAT or other tools can analyze how many tests have run, and how many succeeded:
TEST_RUNNER_REPORT success/total: int/int
where int is replaced by the respective integer number.

Author:

hsommer

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	TATJUnitRunner.KeepTestOutput Test classes can use this annotation to cause TATJUnitRunner to keep the tmp files with the stdout, stderr and test output.

Constructor Summary

Constructors

Constructor and Description
TATJUnitRunner()

Method Summary

Modifier and Type	Method and Description
static void	main(java.lang.String[] args)
static void	run(java.lang.Class testClass) Deprecated. This method is used for compatibility with the old JUnit-3 based version of this class. It will be removed after ACS 11.2.
Result	runMain(java.lang.Class<?> testClass) Modified version of JUnitCore#runMain(JUnitSystem, String...).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TATJUnitRunner

public TATJUnitRunner()

Method Detail

runMain

public Result runMain(java.lang.Class<?> testClass)
               throws java.io.IOException

Modified version of JUnitCore#runMain(JUnitSystem, String...). We restrict ourselves to running only one test class (or suite) at a time. This method is not thread-safe!

Parameters:

testClass -

Returns:

the result

Throws:

java.io.IOException

run

public static void run(java.lang.Class testClass)
                throws java.io.FileNotFoundException

Deprecated. This method is used for compatibility with the old JUnit-3 based version of this class. It will be removed after ACS 11.2.

Throws:

java.io.FileNotFoundException - Hack, even other IOException will be wrapped by FileNotFoundException just for temporary backward compatibility.

main

public static void main(java.lang.String[] args)