116 Commits

Author SHA1 Message Date
Chris Johns
eb3608133b tester: Change to a simpler TFTP server
- Add a simpler TFTP to allow parallel test hardware

- Remove the imported tftpy server

Closes #4063
2020-09-01 09:18:04 +10:00
Chris Johns
4f5485eb51 rtems-test: target_exe_filter fails when there is no filter
Closes #4006
2020-06-17 08:43:00 +10:00
Chris Johns
753eb949b3 tester/gdb: Add lock timing and remote fetching registers.
- Add timing for the locks to aid performance profiling
- Remove fetching registers as the MI parser is slow on pyton2

Updates #3864
2020-03-30 09:52:57 +11:00
Sebastian Huber
274981f77d Improve Python 3 compatibility 2020-03-17 11:36:05 +01:00
Sebastian Huber
0d66fd5264 tester: Use prefix for rtems_tools by default
Commit 72c684eff2cd932b4948e21902680a93473340c3 removed the default
value of rtems_tools.  If the --rtems--tools option was omitted the
rtems-test command printed lots of

	error: run.cfg:61: macro '%{rtems_tools}' not found

error messages.
2020-02-26 07:29:53 +01:00
Sebastian Huber
29ad0ec7a8 tester: Prefer '_' as test state separator char 2019-12-19 10:09:22 +01:00
Hesham Almatary
c02459ee65 tester: Add basic support to generate JUnit test reports 2019-11-22 09:05:23 +00:00
Kinsey Moore
e9f48e9fac Fix exception when no output format is specified
The JSON log generation patch introduced a bug when the report output
generation was not configured due to attempting to iterate over 'None'.
2019-09-24 08:32:52 +10:00
Chris Johns
128ee7b7ec bsp-builder: Do not clean the build space when starting with --no-clean 2019-09-05 09:47:01 +10:00
Chris Johns
72c684eff2 tester: Minor fix to prefix handling. 2019-09-05 09:47:01 +10:00
Chris Johns
89442b7c0c tester/tftp: Handle ctl-C when active. 2019-09-05 09:47:01 +10:00
Kinsey Moore
5fcaf843bd Add JSON log generation
Add log formatter hooks and JSON log formatter to the test infrastructure
for consumption by automated processes or report generators.
2019-08-22 10:41:48 +10:00
Vijay Kumar Banerjee
9f197dea76 rtemstoolkit/path : Add listdir function 2019-05-21 15:53:38 +10:00
Vijay Kumar Banerjee
53dd5e656a coverage: Add subdirectory name in HTML reports 2019-03-27 17:25:45 -05:00
Vijay Kumar Banerjee
8dcfc0ed8a coverage: remove utf-8 encoding in symbolset names 2019-03-22 10:26:12 -05:00
Vijay Kumar Banerjee
f6d30db99b Coverage: Add support for TSIM format 2019-02-14 09:43:40 +11:00
Chris Johns
7f85a65b9d tester: Ignore the execute return code for some commands
Some simulators like psim-run return a non-zero error code. Allow
a BSP configuration to ignore the return code.
2019-02-08 05:41:03 +11:00
Chris Johns
e6bf128eea rtemstoolkit/config: Unlock when printing to avoid blocking. 2019-02-08 05:41:03 +11:00
Chris Johns
5156445f7b tester/check: Convert the indent size to an int. 2019-02-08 05:41:03 +11:00
Vijay Kumar Banerjee
650569cfc5 tester : Add support to use QEMU serial console when coverage is enabled 2018-12-02 14:38:39 +11:00
Vijay Kumar Banerjee
a1498ab899 Coverage : install covoar in tester/bin 2018-11-27 16:55:26 +11:00
Chris Johns
bf5fdab115 tester/tftpd: Set the socket option to reuse. 2018-11-27 11:24:38 +11:00
Chris Johns
a4fbd167eb tester: Fix the handling of the version and tools recs when running parallel jobs 2018-11-27 11:23:36 +11:00
Chris Johns
71cede05ae tester/gdb: mi_parser, fix on Python3 and remove globals
- Fix mi_parser on Python3. Python3 does not support the __cmp__
  operator and rich comparision operators are required, See PEP 207.
- Remove the global variables and make a class containing them. Update
  the gdb class to use the mi_parser session class. Removing the globals
  means the global lock in the gdb module can be removed.
2018-11-26 09:56:50 +11:00
Chris Johns
f632bd8b60 tester: Minor formatting change. 2018-11-26 09:56:13 +11:00
Vijay Kumar Banerjee
fb03e22c47 Coverage: add the style and js files to the symbol-set report directory 2018-11-17 12:31:32 +11:00
Chris Johns
f24e11688e tester: Update the Python TFTP server to fix Python3 issues.
Updated to af2f2fe89a3bf45748b78703820efb0986a8207a.
Repo is https://github.com/msoulier/tftpy.git
2018-11-08 18:13:55 +11:00
Chris Johns
e058db0281 python: Provide support to select a valid python version.
- Update imports after wrapping the code.
- Fix python3 issues.
- Fix config path issues for in repo and install runs.

Closes #3537
2018-11-08 18:13:45 +11:00
Vijay Kumar Banerjee
92a340c305 Coverage : Generate reports using the object files in cpukit 2018-10-25 15:47:26 -05:00
Chris Johns
3bd8def210 config: Consolidate the version information into a single configuration file 2018-10-03 11:38:09 +10:00
Chris Johns
5416cfa39d config: Create a config directory and move the RTEMS arch/bsp data to it.
Closes #3536
2018-10-02 16:49:54 +10:00
Chris Johns
5075e8ed02 tester/bsp-builder: Yield the job control thread when in a dry-run.
This stops a dry-run blocking while the job control thread spins.
2018-09-08 15:36:31 +10:00
Chris Johns
14a12d3645 tester/bsp-builder: Add excluded build options to the base options.
Adding the exclude build options to the base options overrides the
default configure flags. An excluded build could be enabled by
default.

Only pause the jobs loop when it is not a dry run.
2018-09-08 14:42:40 +10:00
Chris Johns
0813c87480 tester/bsp-builder: Fix the build jobs with more than one BSP exclude.
Excluding more than one build resulted in common builds being removed
resulting in a list remove error.
2018-09-04 10:15:46 +10:00
Vijay Kumar Banerjee
18208f826a Coverage: Add support to generate separate reports for each symbol-set
Invoke covoar multiple times from the script to generate separate
reports for each symbol-set.
2018-08-08 11:26:32 -05:00
Chris Johns
c1f2c3247d tester: Add line feeds to the coverage HTML report. 2018-06-19 13:42:03 +10:00
Chris Johns
e341a65347 tester: Make the path to covoar absolute to ignore the env PATH.
Using the environment's path to find covoar allow invalid versions
to be used which may vary in subtle ways. Find and use the covoar
that is build with the version of 'rtems-test'.

This patch means you do not need to install the tools before
running improving the development experience.

Closes #3458
2018-06-18 12:26:16 +10:00
Chris Johns
5195eb735a tester: Clean up the coverage python code. 2018-06-18 12:26:16 +10:00
Vijay Kumar Banerjee
b762312fae tester: Add script to generate html coverage report from covoar output
Add support in tester to run covoar and generate an html report to display
the summary of the coverage reports generated from covoar.

Co-authored-by : Cillian O'Donnell <cpodonnell8@gmail.com>
2018-06-05 18:09:19 -05:00
Chris Johns
b7c4753de0 teater: Filter out an *.norun.* executables. 2018-04-10 14:00:09 +10:00
Chris Johns
cf641a688d tester: List .ini files for BSPs with --list-bsps. 2018-04-10 13:59:43 +10:00
Chris Johns
252d21c8cb bsp-builder: Collect2 messages are errors. 2018-04-10 11:46:11 +10:00
Chris Johns
005f995a80 rtems-bsp-builder: Remove stray %s from the run log message.
Close #3278
2018-02-01 10:51:54 +11:00
Chris Johns
623a641297 rtems-bsp-builder: Add a check for invalid ARCH and BSP names.
If invalid characters are in a BSP or ARCH name generate an error.

Add the missing ',' to the line in the PowerPC BSP configuration.
2018-02-01 09:42:59 +11:00
Chris Johns
30218f5ca5 tester: Add reporting the RTEMS version, build and tools.
Update #3217.
2017-11-11 16:21:52 +11:00
Chris Johns
24d51f7e4b tester: Change the mail subject so it list by BSP in the archives.
Change the subject to place the arch/bsp first and then a short
score card for the tests so the archive can be listed by subject and
you can see regressions.
2017-11-04 11:22:08 +11:00
Chris Johns
42e39d2644 tester: Fix the output so the report end analysis works. 2017-11-03 18:20:31 +11:00
Chris Johns
c68beb8181 tester: Add the rtems-run command. 2017-11-03 17:59:53 +11:00
Chris Johns
0fe3a4b586 tester: Fix rtems-bsp-builder reporting bug 2017-11-01 14:30:32 +11:00
Chris Johns
bb218b62b0 tester: Minor fix to the test results mail. 2017-10-25 10:21:22 +11:00