43 Commits

Author SHA1 Message Date
Chris Johns
b487b7d130 sb/download: Fix --rsb-file options with released sources.
The released sources use the local file name so always force it when
the RSB is released.

Closes #3064.
2017-07-10 11:44:32 +10:00
Chris Johns
f179dc6538 sb: Backport from master the '--rsb-file=' option.
Upates #3033.
2017-06-14 11:22:50 +10:00
Chris Johns
dca7ab2853 sb: Add the release_path key to the version section in the VERSION file.
A release can specify a custom releaase URL path.

Closes #2952.
2017-03-26 13:19:18 +11:00
Chris Johns
87434f6a7c sb: Make the URL output truncate on long long URLs. 2016-03-18 13:34:26 +11:00
Chris Johns
7e04bc3d98 sb: Fix the sensible url printer on Python3.
Updates #2656.
2016-03-17 18:26:37 +11:00
Chris Johns
31f33047a2 sb: Change urlib to urllib2 on Python2 and add user agent support.
Some sites block the standard python user agent. Change to Wget
as it seems to make the tested sites behave.

Limit the size of long URLs when logging to the user.

Closes #2656.
2016-03-17 16:47:31 +11:00
Chris Johns
8f6fb61d53 bare/devel/qemu: Fix the release URL logic and pkconfig python3 issues.
Closes #2645.
2016-03-16 17:17:52 +11:00
Chris Johns
2b5f69e672 sb: Update download to check the config file for release URL control.
Provide without_release_url support in the configuration file so
the release tarball download of the kernel and tools uses the
release's top level directory and not the sources directory.

Closes #2481.
2016-03-14 16:27:14 +11:00
Chris Johns
2e54883325 sb: Fix --without-release-url logic.
Updates #2636.
2016-03-10 16:48:38 +11:00
Chris Johns
58a8fd8b5f sb: Add a download option --with-release-url/--without-release-url.
The default without the option is to prepend the release URL to the URL
list to download from the RTEMS FTP site first if the RSB is released. This
option can force the RTEMS FTP to be tried first when not a release,
or you can supply a different URL to download from or you can request
no RTEMS URL is tried first. Eg:

 --with-release-url
 --with-release-url=file://opt/local/cache
 --without-release-url

Move the RTEMS release URL to the default.mc file. Change the URL
to the RTEMS FTP server and do not use the https method of access.

The option's with_arg call was cleaned up to make sense.

Remove the log's raw output of an extra space.

Some download error message formating was cleaned up.

Closes #2636.
2016-03-10 16:30:30 +11:00
Chris Johns
bce0563a79 sb: Fix typo on the urlparse name in download.py
Updates #2619.
2016-03-10 15:10:06 +11:00
Chris Johns
14392cc60e sb: Download's urllib_parse should point to urlparse on Python2.
Updates #2619.
2016-03-10 15:00:29 +11:00
Chris Johns
f88fcf3ae0 sb: Update code base to support Python3 and Python2.
Fix Windows support to allow MSYS2 Python to be used.

Updates #2619.
2016-03-07 13:16:17 +11:00
Chris Johns
76188ee494 sb: Remove http query flags from the file name if present.
The query flags such as '?h=4.11' to select a branch cannot appear
in the file name on Windows. This patch removes the query part from
the file name.

Update #2616.
2016-02-29 10:43:40 +11:00
Chris Johns
12f253cf2e Download source from RTEMS if a release.
Download source from ftp.rtems.org before the package's URL if
a release.

If a user adds a URL via the command line that is used then the
RTEMS release path then the package's URL.

A user can add --url=file://path/../morepath to have the RSB use
a local cache of source on their hard disk. This is useful if you
need to wipe the RSB and start again. Save away the 'sources' and
'patches' directories to a common directory and provide it with via
the --url option using the 'file://' prefix.

Closes #2482.
2015-12-14 16:09:27 +11:00
Chris Johns
b6d188bb26 Generate an error if there is no hash when released. 2015-12-11 16:21:09 +11:00
Chris Johns
5b5d6bff74 sb: Fix the downloader file:// URL to copy the file to the local path. 2015-06-16 20:57:06 +10:00
Chris Johns
bd16849b11 sb: Update the downloader for 2.7.8 and earlier without a context. 2015-03-30 14:30:56 +11:00
Chris Johns
3237c8ee69 sb: Provide an unverified SSL context to the URL.
The RTEMS servers are causing an exception when downloading patches. The solution is
provided in PEP-0476 (https://www.python.org/dev/peps/pep-0476/#opting-out).
2015-03-29 15:35:00 +11:00
Chris Johns
b0f9e30fa4 Add merge to the git and download modules to merge after a fetch.
Update the RTEMS tools and newlib-git to merge after the fetch.
2015-03-18 08:21:34 +11:00
Chris Johns
d7550652cb Add options support for --with/--without processing. Add --with-download support.
You can now test downloading by using --dry-run and --with-download.

Print the redirect if one is taken.
2015-02-18 10:27:02 +11:00
Chris Johns
d4eb08f55a Windows native build fixes.
The testing of building on Windows is done using MSYS2.
2015-02-07 17:58:17 +11:00
Chris Johns
d790668e39 sb: Add support for the standard git protocols for the %source command.
The source selector 'git://' now supports a protocol option that lets
you set the specific protocol git is to use to access a remote
repository.
2014-08-29 13:14:14 +10:00
Hesham ALMatary
e7a6292cb5 Fix bug of uncompressing zip files.
This patch uses __unzip macro for uncompressing zip files instead of
the wrong __zip macro which is not defined in defaults.mc file.
2014-08-29 11:51:24 +10:00
Chris Johns
d3629a9bae sb: Fix sources related bugs.
Updates the sources module introduced bugs in the build and download
modules. The commit fixes those modules.
2014-08-12 12:59:22 +10:00
Chris Johns
4934771892 sb: Add support to get sources and hashses. 2014-08-09 23:49:29 +10:00
Chris Johns
910081d515 sb: Fix using hashlib's algorithms on python earlier than 2.7. 2014-08-04 18:09:30 +10:00
Chris Johns
a083b52921 Add checksum support for downloaded files.
File download by http, ftp, pw support checksum. The %hash
directive provides a means of setting a hash used to
checksum the file.

Files on disk or just downloaded are checked.
2014-07-29 16:35:43 +10:00
Chris Johns
c49e500042 sb: Add visual feedback for http type downloads. 2014-07-29 10:04:55 +10:00
Chris Johns
fa87409ff0 sb: Fix error handling. 2014-07-25 21:43:50 +10:00
Chris Johns
9a15c40e1b sb: Implement %source and %patch to manage source and patches.
Remove the numbered source and patches and automatically manage
sources and patches. This removes the overhead in maintaining large
collections of patches.
2014-05-13 23:26:09 +10:00
Chris Johns
8c19df26f6 sb: Fix git to clean before updating. 2014-03-26 17:13:47 +11:00
Chris Johns
587aa5fb74 sb: Add patchworks support via the pw://... URL. 2014-02-12 15:26:07 +11:00
Chris Johns
53b918e698 sb: Fix downloader url parsing and add submodule git support.
Split the URL by line breaks into separate requests.

With git reset the repo with each run. First perform a hard reset
to remove any local patches and then switch back to master incase
the repo was left on a branch or a detached head.
2014-02-04 18:23:08 +11:00
Chris Johns
0ed876c0a9 Do not run any download type functions if performing a dry-run. 2013-04-29 08:58:01 +10:00
Chris Johns
c65b9eb7ec Change the CVS download path to include the module and tag/date. 2013-04-25 15:06:20 +10:00
Chris Johns
f077b2b190 Fixes for CVS to work. Add RTEMS build for sparc/sis. 2013-04-22 22:28:27 +10:00
Chris Johns
5f44fcdd1b Fix CVS downloads. 2013-04-21 21:43:17 +10:00
Chris Johns
5142becd8e Refactor the logging support. 2013-04-21 18:37:02 +10:00
Chris Johns
29a300a766 Fix the ZIP label. 2013-04-20 21:51:10 +10:00
Chris Johns
4ce931b413 Add CVS download support.
These changes complete the CVS download support.
2013-04-20 21:47:28 +10:00
Chris Johns
f8bdb41bef Minor clean up. 2013-04-16 14:57:27 +10:00
Chris Johns
649a64c0af Add download git support.
Add support to use a git cloned repo as the source. Move the download
code out of the build module and into a separate module. Add to this
module support for git.

Update the GCC common configuration to support using a symlinked
git repo.

Add checks for all languages.
2013-04-16 14:28:34 +10:00