Changes
Page history
Update Testing
authored
Aug 25, 2021
by
Fabian Nuraddin Alexander Gabel
Hide whitespace changes
Inline
Side-by-side
Testing.md
View page @
d8b51d61
...
@@ -4,19 +4,30 @@ In order to assure that the preprocessor and building scripts work as intended,
...
@@ -4,19 +4,30 @@ In order to assure that the preprocessor and building scripts work as intended,
# Test Template
# Test Template
Each test has
4
stages:
Each test has
5
stages:
*
Prepare variables
*
[
Prepare
generic
variables
](
#genericvariables
)
.
*
Run the script to be tested (with different combinations of input arguments
*
Run the script to be tested (with different combinations of input arguments
*
Check the result, usually via a
[
`diff`
](
https://en.wikipedia.org/wiki/Diff
)
command.
*
Compare the output with a reference file usually via a
[
`diff`
](
https://en.wikipedia.org/wiki/Diff
)
command.
*
Exit with exit code
`1`
if script is failed or continue with next test.
*
Check whether all files where created using
`if [ -f ...]`
*
Exit with exit code
`1`
if script has failed or continue with next test.
## Generic Variables
In order to modularize tests, the following generic variables are used:
| Name | Description | Example Value |
| ---- | ----------- | ------- |
|
`$RESEARCH_TESTING`
| The base directory for this test |
`$RESEARCH_ROOT/testing/test_preproc_wg.log`
|
|
`$LOGFILE`
| The name of the logfile for this test |
`$RESEARCH_ROOT/log/preproc_wg.log`
|
|
`$SCRIPT`
| The basic command that is tested |
`$RESEARCH_ROOT/bin/preproc_wg.sh`
|
## Plain template
## Plain template
Use this template in order to register new tests; replace
`NN`
and
`Description`
accordingly:
Use this template in order to register new tests; replace
`NN`
and
`Description`
accordingly:
```
bash
```
bash
#BEGIN Test
1
: Description
#BEGIN Test
NN
: Description
T
=
1
T
=
NN
#echo "##################################################"
#echo "##################################################"
echo
"Test
$T
: Description"
echo
"Test
$T
: Description"
#echo "##################################################"
#echo "##################################################"
...
...
...
...