73 Commits

Author SHA1 Message Date
Chris Johns
158ad680ae sb: Back port the RTEMS 5 and 6 RSB engine.
- Build GDb first as we do for RTEMS 5 and later

- Update GDB to 9.1 for all archs expect SPARC. The SIS patches
  only apply to 7.9. Disable Python for SPARC

Closes #4111
2020-10-06 12:00:21 +11:00
Chris Johns
de9ca906d3 sb: RSB backport changes to support mailing list posting of builds.
This requires moving to markdown for HTML and so asciidoc can be removed.

Close 3289
2018-02-05 15:32:57 +11:00
Chris Johns
6b0d76cc9b sb: fix the if logic to handle directives in if statements.
Directives in if statements end at the end of an if. The cannot
change or split across directive boundaries.

Add more trace detail to config.py.

Updates #2661.
2016-03-19 17:23:50 +11:00
Chris Johns
0e22c3c7ff sb: Support --dry-run --with-download for 3rd party RTEMS BSP packages.
The building of 3rd party packages for an RTEMS BSP requires a valid
BSP so the standard method to download the source for releasing does
not work. This change adds support to allow this. The RTEMS BSP support
will not generate an error is no BSP or tools are provided or found.

The change addis logic operators to the %if statement so you can '||'
to 'or' and '&&' to 'and' logic expressions.

A new %log directive has been added to clean up the messages.

A new %{!define ...} has been added to aid checking within logic
expressions.

All command line --with/--without now appear as macros.

Add version.version to get just the RTEMS major and minor version.

Some pkg-config issues have been resolved.

Closes #2655.
2016-03-17 16:39:57 +11:00
Chris Johns
e70a165d6d sb: Do not expand the package name in a bset file.
If the package references macros yet to be defined an error is
generated. Let the macro expands happen when the package name is
actually used.

Closes #2645.
2016-03-16 17:17:40 +11:00
Chris Johns
bce0563a79 sb: Fix typo on the urlparse name in download.py
Updates #2619.
2016-03-10 15:10:06 +11:00
Chris Johns
e02eaa67b6 qemu: Add a package name to create a tarball. 2016-03-07 15:02:25 +11:00
Chris Johns
f88fcf3ae0 sb: Update code base to support Python3 and Python2.
Fix Windows support to allow MSYS2 Python to be used.

Updates #2619.
2016-03-07 13:16:17 +11:00
Chris Johns
a7691f0a38 Wrap the tar command in double quotes for Windows cmd.exe.
Windows cmd.exe does not support a single quote for options. Change to
a double quote.

Closes #2615.
2016-02-25 14:30:36 +11:00
Chris Johns
e8f511157c sb. Add VERSION support for releasing the RSB.
Add support to release the RSB by adding the VERSION file. The file
is a single line with the version.

Fix the reports to include the version. Update the INI file
support to include the details of the build.

Show the GIT or released version when the command starts.

Closes #2480.
2015-12-03 22:22:17 +11:00
Chris Johns
7385feb274 Canandian Cross Compiling and RTEMS 3rd party package building Fixes.
The change fixes installing for RTEMS 3rd Party packages where the
RSB considered them Canadian Cross Compiling (Cxc). Fixing the
Cxc issue broke real Cxc builds. The change corrects the issue of
macros being changed in the Cxc and the prep data not being udpated.
The configuration is loaded again after the updated macros. The
macros are also copied and restored to ensure a clean stable base.

The change also introduces --rtems-tools and --rtems-bsp to align
the command line with the waf configure process or RTEMS application.
2015-07-21 16:56:53 +10:00
Chris Johns
4bd058ea7c sb: Always generate an XML report. 2015-05-22 12:20:41 +10:00
Chris Johns
ce60578b8f sb: Fix reporting and installing the reports when building.
Switch the default report to text format.
Fix the report to support the set builder.
2015-05-21 21:49:25 +10:00
Chris Johns
eeded980e5 Fix the check to see if the path is writable. 2015-01-26 11:57:43 +11:00
Chris Johns
3963ac4aae Detect a Cxc build from the options and automatically disabled installing.
This is similar to always providing --no-install on the command when building
a Cxc package.
2015-01-18 11:24:11 +11:00
Chris Johns
53290f9bd7 sb: Add a dry run footer to ereports. 2014-08-14 07:10:52 +10:00
Chris Johns
a083b52921 Add checksum support for downloaded files.
File download by http, ftp, pw support checksum. The %hash
directive provides a means of setting a hash used to
checksum the file.

Files on disk or just downloaded are checked.
2014-07-29 16:35:43 +10:00
Chris Johns
120e101ca3 sb: Improve the error handling for setbuilder errors.
If an error happens in the setbuilder code report the error. Errors
in the build phase are logged in the RSB Error Report.
2014-06-15 17:12:10 +12:00
Chris Johns
65d94573a5 sb: Move error report generation to the build phase.
Generate a separate report of each package being built in a build set.
This creates a better list of faults in the case of nesting build sets
such as */rtems-all.
2014-05-15 08:49:34 +10:00
Chris Johns
9a15c40e1b sb: Implement %source and %patch to manage source and patches.
Remove the numbered source and patches and automatically manage
sources and patches. This removes the overhead in maintaining large
collections of patches.
2014-05-13 23:26:09 +10:00
Chris Johns
74da24cb61 sb: Generate an error report on an error.
Generate an error report users can send to the mailing list with
error details.
2014-05-08 13:20:29 +10:00
Chris Johns
ce0f7a19c3 Add the host to the build set tar file name if no target.
If building a host package use the host as the package tar file
name prefix. This means the tar files will all start with the host
name.
2013-11-10 09:55:37 +11:00
Chris Johns
b843e623c4 sb: Do no install with a Cxc build. 2013-09-05 16:32:50 +10:00
Chris Johns
2802080426 sb: Do not create a build set tar file on error.
If creating build set tar files and using --keep-going do not create
the tar file if any part of the set build fails.
2013-09-04 08:45:04 +10:00
Chris Johns
72f89c5fc9 sb: Output the new info message.
With the set builder add nesting count support.
2013-09-03 08:29:36 +10:00
Chris Johns
869b8a6bd3 sb: Fix the copy tree.
Python's distutil's copy tree code maintains a cache of directories
created so deleting a tree a different way then coping the same
tree results in an error because the destination folders in the
tree are not present because distutils thinks they exist. The
solution is to implement a copy tree function.
2013-08-15 12:20:29 +10:00
Chris Johns
01b28157ff SB: Fix internal build and mailing. Output errors to the log. 2013-07-21 10:22:03 +10:00
Chris Johns
ebf8a1f0f8 Automtically build the Autotools to bootstrap RTEMS.
This changes adds support to build the autotools if the host installed
version is not a suitable version. Autoconf and automake have hard coded
references to the install prefix and host tools and this makes it impossible
to relocate, that is use in any path other than the install prefix. To
bootstrap automake you need to first build a suitable autoconf and with that
you can built automake for the install prefix. The other complication is
not referencing the install prefix in the path when building in the RSB.
Having the install prefix in the path can result in strange issues appearing
such as gcc using a new assembler feature not present in an older assember
installed under the install prefix.

The process is to build the autotools using an install prefix to an
internal path inside the RSB temporary path and to use that autoconf
to build the version for the install prefix. The internal install
prefix version is also used to bootstrap RTEMS.
2013-07-16 10:02:41 +10:00
Chris Johns
8a1e7a0ab0 Add better error messages. 2013-05-14 11:12:54 +10:00
Chris Johns
04f447f979 Show a trace message on copy when with --dry-run. 2013-05-13 14:47:14 +10:00
Chris Johns
df56f7ee09 Improve the email reporter. 2013-05-01 10:42:08 +10:00
Chris Johns
c914e1d306 Add tail support to the log. Email the log tail in a failure. 2013-05-01 10:08:36 +10:00
Chris Johns
97a685fae3 Add mail support to mail reports. 2013-04-30 11:20:54 +10:00
Chris Johns
adf09460a2 Report from the setbuilder's build config.
Refactor the reporter to allow the setbuilder to use its build config
rather than regenerating the configuration from the configuration file.
Using the config file and the build macros exposed an issue if a
macro was undefined that was defined in a build set above the
config file. Using the build set's configuration as used to build
is a better solution.

The reporter was refactored to allow a config class to be used
to report.

The setbuild can now take a configuration file as an input file.
2013-04-29 09:01:14 +10:00
Chris Johns
5142becd8e Refactor the logging support. 2013-04-21 18:37:02 +10:00
Chris Johns
2cc7a974a5 PR 2117 - Only check the prefix is writable if installing and not a dry run. 2013-04-15 12:16:26 +10:00
Chris Johns
9994530920 PR 2115 - Check prefix path write access before starting to build.
Added a check in the options post processing to check is the
prefix path allows writes. No actual write check is made. just
the permissions are checked. If the --no-install options is
used the check is not made.

Moved the --no-install option from the set builder to the options
module.
2013-04-15 10:05:23 +10:00
Chris Johns
8508944647 PR 2115 - Fixed the exception on no 'what'. 2013-04-15 09:48:42 +10:00
Chris Johns
e45a2e4b1d Bug fix the list name. 2013-04-14 07:54:58 +10:00
Chris Johns
cb12e4875c Refactor defaults, macros and options.
To support building snapshots and pre-release source the defaults
has been refactored. The defaults have been moved to a stand alone
file and a macros.py module added. This modile abstracts the
old default dictionary turning it into a class. The macros
class can load macros from a file therefore the defaults have
been moved to a stand alone file.

The use of defaults has been removed from the project. The only
case where it is used in the options where the defaults are read
from a file. Macros are used everywhere now.

The defaults.py has been moved to the option.py and the separate
options and defaults values has been moved to a new pattern. When
constructing an object that needs macros and options if the macros
passed in is None the defaults from the options are used. This makes
it clear when the defaults are being used or when a modified set of
macros is being used.

The macros class support maps. The default is 'global' and where all
the defaults reside and where configuratiion file changes end up.
Maps allow macros to be read from a file and override the values
being maintained in the 'global' map. Reading a macro first checks
the map and if not present checks the 'global' map.

The addition of maps to the macros provides the base to support
snapshots and pre-release testing with standard configurations.
This functionality needs to be added. It works by letting to
specify a snapshot with:

source0: none, override, 'my-dist.tar.bz2'

and it will be used rather the value from the standard configuration.
With a build set you need to also specify the package these macros
are for. The maps provide this.
2013-04-09 13:51:43 +10:00
Chris Johns
54993543d7 Remove the deep copy and use a shallow copy so it worked on Python 2.6. 2013-04-06 08:28:09 +11:00
Chris Johns
affea817cd Fix the version module's name. 2013-04-05 14:10:48 +11:00
Chris Johns
efb6688be0 Support a common verion number for all commands. 2013-04-05 09:17:47 +11:00
Chris Johns
0add2eaa70 PR 2108, PR 2109. Add --jobs and --always-clean.
Refactor the options handling in defaults.py to allow the --jobs
option have varing specific parameters. The option supports 'none',
'max' and 'half' or a fraction to divide the number of CPUs or
an integer value which is the number of jobs. The --no-smp has
been removed.

The host specific modules have been changed to set the number of
CPUs in the defaults table.

Fixed the --keep-going to clean up is --always-clean is provided
even if the build has an error.
2013-04-03 14:31:41 +11:00
Chris Johns
4f26bdb2f0 Add Canadian Cross support.
Add support to build MinGW tools using Cygwin. This is a Canadian cross
build.

Do not expand the directives when parsing a configuration file. Hold
in the package object the text as read from the configuration file. Still
parse the logic but leave the macros. This allows a configuration to be
varied when the build happens. The Canadian cross uses this to build a
build compiler used to build a Cxc runtime.

Add Cxc support to the build module. In the defaults add rm and rmfile
macros, add Cxc paths and pre-build script code.

In the setbuilder check for a Cxc build and if so and the package
allow Cxc build the build host version then the host target
version.

Add cygiwn support to the defaults processing and to the Windows module.
2013-04-01 15:19:56 +11:00
Sebastian Huber
1e1ea1e1a2 Install reports under "share" directory
This is normally the place for architecture-independent (shared) data.
2013-03-23 08:55:56 +11:00
Chris Johns
aa4f8f66e0 Generate a better error message. Use the package name in the installing message. 2013-03-15 15:34:24 +11:00
Chris Johns
fa653c2ce2 Use the new opts define and add an undefine. 2013-03-12 18:30:15 +11:00
Chris Johns
5cba075c71 Improve the parsing in build set files. 2013-03-11 10:39:57 +11:00
Chris Johns
b48dc23f95 Define as a macro as the remaining fields of the split. 2013-03-08 18:20:11 +11:00