aboutsummaryrefslogtreecommitdiffstats
path: root/scripts/shared-repo-unpack
AgeCommit message (Collapse)Author
2023-01-26scripts/send_qa_email.py: Rename send-qa-email to send_qa_email.pyAlexis Lothoré
This rename fixes send-qa-email regarding python guidelines, which allows to import the script content in another script (for unit testing purpose for example) Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-09-26scripts: Ensure gplv2 revision isn't listed and repos aren't usedRichard Purdie
We disabled meta-gplv2 for master, ensure the repo isn't used in the collection or QA scripts. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-17Clarify license and copyright informationRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-31shared-repos: Use tar instead of rsync for speedRichard Purdie
The rysnc of 20,000 files (650MB) onto the nas is slow taking ~3 minutes at idle and worse at load. This is due to the number of files which is a pain point for NFS. This piece of the build is also a bottleneck since the rest of a build depends on it happening. If we switch to zstd compressed tar, it takes 2.49s. Other compression methods were much slower but zstd seems 'accptable' and speeds things up too. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20scripts/shared-repo-unpack: Add flush call to update the output more ↵Richard Purdie
regularly before buildtools Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-27scripts/run-config: Share buildtools setup code with shared-repo-unpackRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-27scripts/shared-repo-unpack: Accept workername parameterRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02layer-config, shared-repo-unpack: Sub-repos in NEEDREPOSThomas Goodwin
The previous fixes requires the user to set "no-layer-add" for a repo and then use ADDLAYER to insert the sub-repos (e.g., meta-openmbedded/meta-oe) as a two-part process. This means that you would also have to specify that flag if a repo that is a layer with dependencies is in the list so that it can be inserted in the correct order later via ADDLAYER to avoid parsing problems. This fix allows for specifying a NEEDREPOS with the subdirectory of the target layer (e.g., meta-openembedded/meta-oe) so that there is no need for the "no-layer-add" followed by ADDLAYER combination. The entire meta-openembedded repo would be moved into place, and the sublayer added to bblayers.conf. Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02shared-repo-unpack: suppressing exception, returning exit codeThomas Goodwin
The preceeding errors that would be shown should be enough to identify the problem since it would have been a problem running bitbake-layers add-layer, indicating a misconfiguration of config.json. Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30scripts: use argparse for command line parsingPaul Eggleton
[RP: Minor tweaks made to adpat to buildbot and option naming Fixed shared-repo-unpack for publishing when no cache-dir supplied] Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20utils: Allow customisation using ABHELPER_JSON from the environmentRichard Purdie
Usage is documented in README and an example, local-example.json is included. Also clean up the parameter to loadconfig() as its actually not needed. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20scripts: Convert to use data expansion pretty much everywhereRichard Purdie
We want to be able to use data expansion/variable substitution in most variables so convert to use the utils API for this. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-05Add support for publishing the layer tarballsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-30shared-repo-unpack: Drop now unneeded directory deletionRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-29shared-repo-unpack: Allow shared to be unspecifiedRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-25shared-repos-unpack/layer-config: Use topdir and repos subdirs for ↵Richard Purdie
checkouts/builds Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-24shared-repo-unpack: fix mv callsJoshua Lock
As the mv commands use a filename wildcard we need to tell check_call to execute through the shell so that the wildcard is expanded, rather than treat as a file name. Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-01-24shared-repo-unpack: make moving old repos more resilientJoshua Lock
Only move the directory contents if they exist, try to move dot files after moving non dot files. Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-01-24shared-repo-unpack: move existing dir's contents, not dir itselfJoshua Lock
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-01-24shared-repo-pack: Add missing importsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-24shared-repo-pack: Move out any existing build directory to the trash ↵Richard Purdie
delection handler Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-23shared-repo-unpack: Call layer-configRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-23shared-repo-unpack: Correct the rsync commandRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-23utils/shared-repo-unpack: Create common mkdir function and fix ↵Richard Purdie
shared-repo-unpack to create directory to rsync to Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-23scripts: Fix help text and program nameRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-22Add repo filtering functionality per targetRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-22shared-repo-unpack: Fix missing variableRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-22prepare-shared-repos/shared-repo-unpack: Allow future option to filter repos ↵Richard Purdie
and implement more functionality Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-22Add initial repo handling scriptsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>