Chris Johns
c73e03040f
tester: Check mail parameters early so users can fix.
2017-10-25 10:13:28 +11:00
Chris Johns
41d0c343ee
tester: Add a BSP field to each BSP INI configuration section.
...
The INI section in a BSP configuration is the name of the INI file so
each BSP configuration section needs a BSP.
Updates #3204 .
2017-10-25 09:03:43 +11:00
Chris Johns
bf58911519
tester: Refactor to use INI format files for BSP configurations.
...
- Add support for user condfigurations files with the --user-config.
- Add support for a $HOME/.rtemstesterrc for a user configuration.
Closes #3204 .
2017-10-24 22:21:35 +11:00
Chris Johns
5251361066
tester: Add an executable file name filter.
...
The exe filter lets a BSP change the executable file to something
that can be downloaded to the target. For example U-Boot requires the image
format. The tester can now be configured to on-demand generate a specific
image for the target as the tester runs.
2017-10-23 15:22:34 +11:00
Chris Johns
7051ba5b19
bsb-builder: Add email support, and config report types.
2017-10-22 18:56:26 +11:00
Chris Johns
f1e8fd49dd
tester: Add pretest and posttest target commands with @ARCH@, @BSP@ and @EXE@ substitution.
2017-10-21 17:04:53 +11:00
Chris Johns
cec5878ad3
tester: Remove pass status messages from the email log posts.
2017-10-21 16:20:04 +11:00
Chris Johns
af6a54d7c8
tester: Use a target ON command before the first test.
2017-10-21 16:20:04 +11:00
Chris Johns
ac679ba950
tester: Print the host and port on error in telnet connect.
2017-10-21 16:20:04 +11:00
Chris Johns
5e40b4a163
tester: Fix excluded fails processing.
2017-10-12 06:25:10 +11:00
Chris Johns
89e8c2abb6
tester: Add support to email results.
2017-10-12 06:13:47 +11:00
Chris Johns
fce29b0c1f
tester: Change the capture console prompt to avoid email reply processing in clients.
2017-10-12 06:13:13 +11:00
Chris Johns
4b76b8ef7f
testing: Generate console message on a second TFTP exe request.
2017-10-11 22:51:02 +11:00
Chris Johns
0eb84005f4
testing: Print the output after the result. Easier to find and review failures.
2017-10-11 22:51:02 +11:00
Chris Johns
662e1f7d9a
tester: Add a tester off to turn the target off when finished.
...
Turning the target off stops it sitting asking for a download if you have
more than one target in a test set up. Any target can jump in and
nick the download.
2017-10-10 13:30:31 +11:00
Chris Johns
9580804ae5
Add a target start and target reset to manage boards that do not boot cleanly.
...
Rename the reset regex as start regex to detect a board has started.
Add a reset regex to detect if a board has failed to boot cleanly and
needs to be reset.
The Microzed I have can fail to boot. The PHY does not initalise.
I do not know if it is the board, the design or u-boot.
2017-10-07 18:57:24 +11:00
Chris Johns
2ae9b6d52b
tester: Telnet console reopens the connection if it fails or closes.
...
Some hardware can drop a USB serial enumeration when power is
remove or applied. This changes make the telnet console more
fault tolerant.
2017-10-05 14:21:33 +11:00
Chris Johns
0737b4603b
tester: Add a target reset regular expression to detect a reset.
2017-10-05 14:21:01 +11:00
Chris Johns
3c7cd05593
tester: Fix the TFTP ok to kill deadlock.
2017-09-21 21:34:34 +10:00
Chris Johns
3ed65c0106
Lower the step size for the TFTP timeout.
2017-09-21 21:33:56 +10:00
Chris Johns
3a867a4919
Add TFTP as a back end option for testing. Add telnet as a console option.
...
TFTP runs a local TFTP server on port 69 or another specified port and
serves each test for any requested file.
Telnet is now a console option.
2017-09-21 18:26:20 +10:00
Chris Johns
d67c20abe3
rtems-bsp-builder: Use the profile's architecture's BSP lists.
2017-05-31 22:16:18 +10:00
Chris Johns
37a08438ca
rtems-bsp-builder: Refactor to add jobs.
...
This change adds job support to the rtems-bsp-builder so builds can
run in parallel.
Some options have changed so they make sense and are more useful.
2017-05-24 12:27:38 +10:00
Chris Johns
ef38b5d7c2
rtemstoolkit: Add Python INI configuration support.
2017-05-15 11:48:44 +10:00
Chris Johns
9a8a03c713
rtems-bsp-builder: Add all architectures and BSPs.
...
- Add support to include other INI files.
- Add support for extended interpolation on Python 2.7.
2017-05-15 11:29:46 +10:00
Chris Johns
85e14e0cbf
rtems-bsp-builder: Fix excluding builds.
...
Excluding builds was not working. This patch fixes that and it
also correctly handles mixed builds.
2017-05-10 21:09:02 +10:00
Chris Johns
ad15f6b2ce
rtems-bsp-builder: Fix passes report alignment.
2017-04-28 06:49:23 +10:00
Chris Johns
096c95e9a2
rtems-bsp-tester: Make the failure and pass report more compact.
2017-04-28 06:36:32 +10:00
Chris Johns
fc22d2a05e
rtems-bsp-builder: Fix time in warnings report, wrapping in reports.
...
Also fix accessing group counts when there are no counts.
2017-04-26 22:07:15 +10:00
Chris Johns
c2df65bcf6
rtems-bsp-builder: Fix access when there are no messages.
2017-04-26 20:01:23 +10:00
Chris Johns
ab57e79715
rtems-test: Fix gdb bug.
2017-04-25 09:32:18 +10:00
Chris Johns
b89a7e4b18
rtems-bsp-builder: Fix the build sets excludes.
2017-04-25 08:40:19 +10:00
Chris Johns
5d1edd55c8
rtems-bsp-builder: Refactor for better config format, warnings and errors.
...
Refactor the code to improve the warnings and errors reporting.
Improve the configuration file format to better support any type
of build by separating the flags away from the builds.
2017-04-25 02:39:56 +10:00
Chris Johns
7d3350d0bb
rtemstoolkit: Move host support access into a separate module.
...
Moving the host support into a module lets it get used where options
is not being used.
2017-04-25 00:31:44 +10:00
Chris Johns
15a3e06518
tester: Add support for expected-fail, user-input, and benchmarks.
...
Count the errors for the states listed and add running totals.
Kill the test process if the test state is user-input or benchmark.
2017-04-04 13:32:03 +10:00
Chris Johns
bce090b242
rtems-bsp-builder: Fix the counts to accumulate.
2017-03-28 10:20:14 +11:00
Chris Johns
056bd4b87f
rtems-bsp-builder: Fix profile error message.
2017-03-15 15:23:40 +11:00
Chris Johns
a72a462adc
bsp-builder: Fix final output errors.
2016-12-13 09:56:25 +11:00
Chris Johns
d3d771e95f
bsp-builder: Add support for builds.
...
Add build support where a build is a combination of options. The
default is 'all' which is a full set of build options passed to
configure. You can now use 'basic' which is the standard or default
configure command line. This used with the arch option lets you
quickly build all BSPs in an architecture.
For example:
$ rtems-bsp-builder --build-path /builds/rtems/builds/arm \
--rtems-tools /opt/rtems/4.12 \
--rtems /opt/rtems/src/rtems.git \
--arch arm --build basic
2016-12-01 10:21:13 +11:00
Chris Johns
8a7be6379c
bsp-bulder: Get the end time when building an architecture.
2016-11-30 08:13:33 +11:00
Chris Johns
a252faf1d3
bsp-builder: Results format fixes.
2016-08-30 18:10:17 +10:00
Chris Johns
06c3ccdcf3
bsp-builder: Fix bugs.
2016-08-29 11:47:04 +10:00
Chris Johns
f7f0704905
bsp-builder: Fix column printing of the arch/bsp.
2016-08-25 16:13:18 +10:00
Chris Johns
8e13939aa0
bsp-builder: Print one results report only.
2016-08-19 11:56:09 +10:00
Chris Johns
9a1daba2ff
bsp-builder: Fix results report columns.
2016-08-19 09:55:03 +10:00
Chris Johns
51e19af92d
bsp-builder: Support per BSP excludes.
2016-08-18 21:00:29 +10:00
Chris Johns
57e4172c26
tester: handle compile argument warnings.
2016-08-18 14:24:45 +10:00
Chris Johns
3e1459496a
Add rtems-bsp-builder.
...
This is a testing tool that builds BSPs with a range of configure options
for regression testing changes do not break the kernel code.
The builds are controlled by an INI file. The INI configuration has profiles
which define a specific set of architures and BSP to build. There are architectures
which contain BSPs and these further define the options needed to build the BSP.
There is also builds which define the variations each BSP is built with.
The build output can be pointed to any suitable disks so you can control where
the output ends up.
This initial release contains tiers and these are only seeded with something to
test with. It does not define the tiers.
Wanrings, object files and libraries are counted.
2016-07-06 17:58:56 +10:00
Chris Johns
dfa2468af6
tester: Fix reraising an exception with Python2 and Python3.
...
Updates #2619 .
2016-03-16 21:39:39 +11:00
Chris Johns
1845e9132e
tester: Provide a gdb kill method to aid clean ups on ctrl-C.
2016-03-16 16:21:57 +11:00