20 Commits

Author SHA1 Message Date
Chris Johns
a22b396a32 tester/tftp: Add a session timeout
- Fix listener done state

- Finish open with the state as finished

Closes #4959
2023-11-08 08:34:14 +11:00
Sebastian Huber
203077030d tester: Check for begin/end of test
Check for "BEGIN OF TEST" and "END OF TEST" to not use other information blocks
such as "END OF GCOV" to determine the test status.
2022-10-07 06:26:31 +02:00
Sebastian Huber
e3a5912249 tester: Fix string representation 2022-07-26 13:43:37 +02:00
Chris Johns
9d880d78b2 tester: Count tester header errors
- Remove the hard tester error and count the header errors.
2021-09-09 18:33:54 +10:00
Kinsey Moore
2bb7d3a1bb tester: Report fatal-error test states as failures
Tests resulting in the fatal-error state are counted as failures, but
are not currently reported in the text summary. This has already been
fixed for JSON output.
2020-11-25 16:18:03 -06:00
Kinsey Moore
79a9a46a20 tester: Prevent crash with json output
This fixes an issue with json report output that causes a crash due to
the incorrect object member being accessed for test-too-long. This also
changes treatment of fatal errors to match how they are displayed in the
tester log output and changes "fatal error" to "fatal-error" to better
match the naming of all the other failure types.
2020-10-05 18:58:40 -05:00
Chris Johns
cd8fa2fe74 tester: Add support for test-too-long
- A test that loops generating output did not timeout. Monitor the
  the session time and set a maximum test period.
2020-09-08 16:15:43 +10:00
Sebastian Huber
29ad0ec7a8 tester: Prefer '_' as test state separator char 2019-12-19 10:09:22 +01:00
Chris Johns
a4fbd167eb tester: Fix the handling of the version and tools recs when running parallel jobs 2018-11-27 11:23:36 +11:00
Chris Johns
30218f5ca5 tester: Add reporting the RTEMS version, build and tools.
Update #3217.
2017-11-11 16:21:52 +11:00
Chris Johns
24d51f7e4b tester: Change the mail subject so it list by BSP in the archives.
Change the subject to place the arch/bsp first and then a short
score card for the tests so the archive can be listed by subject and
you can see regressions.
2017-11-04 11:22:08 +11:00
Chris Johns
bf58911519 tester: Refactor to use INI format files for BSP configurations.
- Add support for user condfigurations files with the --user-config.
- Add support for a $HOME/.rtemstesterrc for a user configuration.

Closes #3204.
2017-10-24 22:21:35 +11:00
Chris Johns
5251361066 tester: Add an executable file name filter.
The exe filter lets a BSP change the executable file to something
that can be downloaded to the target. For example U-Boot requires the image
format. The tester can now be configured to on-demand generate a specific
image for the target as the tester runs.
2017-10-23 15:22:34 +11:00
Chris Johns
5e40b4a163 tester: Fix excluded fails processing. 2017-10-12 06:25:10 +11:00
Chris Johns
89e8c2abb6 tester: Add support to email results. 2017-10-12 06:13:47 +11:00
Chris Johns
0eb84005f4 testing: Print the output after the result. Easier to find and review failures. 2017-10-11 22:51:02 +11:00
Chris Johns
3a867a4919 Add TFTP as a back end option for testing. Add telnet as a console option.
TFTP runs a local TFTP server on port 69 or another specified port and
serves each test for any requested file.

Telnet is now a console option.
2017-09-21 18:26:20 +10:00
Chris Johns
15a3e06518 tester: Add support for expected-fail, user-input, and benchmarks.
Count the errors for the states listed and add running totals.

Kill the test process if the test state is user-input or benchmark.
2017-04-04 13:32:03 +10:00
Chris Johns
6f8b07c3b6 rtemstoolkit: Fix execute's writer thread to not eval() the input.
The conversion to Python3 added an eval() call which is wrong.

Fix the spelling in execute.

Fix labels in the tester gdb locking.

Check the debug-trace arguments.

Close #2642.
2016-03-14 14:59:11 +11:00
Chris Johns
50fdf12244 rt: Add the rtems-tester. 2014-02-15 06:30:06 +11:00