aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
23 hoursconfig-json: use quillback branch for meta-aglcontrib/kirkstone-nextSteve Sakoman
kirkstone is no longer supported on master branch Signed-off-by: Steve Sakoman <steve@sakoman.com>
2024-03-04config.json: use buildtools for Ubuntu 18.04 (both x86 and arm)kirkstoneSteve Sakoman
Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-04config.json: update to latest buildtools tarballSteve Sakoman
Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-01-24cve-report: Add summary counts of CVEs by recipeRichard Purdie
It is often helpful to know how many CVEs are open against a given recipe. Add a summary table of this to the end of the CVE listing. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-01-02config.json: Make meta-oe source mirror config wider coverageRichard Purdie
Some recipes depend on DISTRO_FEATURES, commercial licensing or compiler config like fortran. Set these things so that we get wider soruce mirror coverage and fewer warnings. 'commercial' license usage is ok here since we're not building and then shipping any binaries or using it, only mirroring the source code. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 93d47af8abbc6558f9a098a0c7fa6c0e901424a9) Signed-off-by: Yoann Congal <yoann.congal@smile.fr> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-11-03scripts/run-cvecheck: pull before updating metricsRoss Burton
Do another git-pull in the metrics repository before updating the metrics, in case other metrics jobs running in parallel have updated the repositories since they were cloned. There will always be possibility of racing metrics jobs, but this should reduce the chance of it happening. An alternative would be to commit and then rebase before pushing, but I fear that a git-merge could produce invalid JSON and we'd have to manually fix up the repository. In my opinion, a wasted metrics run is preferable to potentially corrupted repositories. [RP: Moved to after the bitbke invocation] Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-11-03config.json/scripts: Update to handle CVE checks for meta-oeRichard Purdie
Backport the recent CVE script changes from the master branch and add in cvelayer.bbclass as a way to exclude specific paths from the CVE check. Master can use the layer overrides to do this but these are not present on kirkstone. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-10-28config.json: Fix check-layer for meta-poky/meta-yocto-bspRichard Purdie
Currently, the tests for meta-poky and meta-yocto-bsp were malfunctioning. We need to a) set a distro other than poky and b) avoid the isolation wrapper since it will use the default environment and reset to the poky distro and default bblayers.conf which will disable the layer test. With those two fixes, the layer checks work correctly. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-10-26config.json: pipewire is no longer a dependency of agl-coreRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-10-24SECURITY.md: Add fileRichard Purdie
Add a SECURITY.md file with hints for security researchers and other parties who might report potential security vulnerabilities. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-10-23metrics: Pull updates from master branch to run per-branch CVE testingRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-10-23config.json: update to latest buildtools tarballSteve Sakoman
Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-10-19meta-oe-mirror: Use a 2 step job to fetch and verify meta-openembedded mirror.David Pierret
Inspired from trigger-build and trigger-build-post-trigger The branch must be selected on build configuration. Signed-off-by: David Pierret <david.pierret@smile.fr> Reviewed-by: Yoann Congal <yoann.congal@smile.fr> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-10-16config.json: meta-aws add oe meta-multimedia dependencyThomas Roos
Signed-off-by: Thomas Roos <throos@amazon.de> Signed-off-by: Steve Sakoman <steve@sakoman.com>
2023-10-08config.json: Pull using ssh:// instead of git://Michael Halstead
git:// is less performant than https:// and ssh://. We are using ssh:// to ensure we have the very latest commits. The public mirrors may have a 30 second delay while they sync. Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-26scripts/send-qa-email: Add URL of build to QA emailRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-26scripts/send_qa_email.py: Rename send-qa-email to send_qa_email.pyAlexis Lothoré
This rename fixes send-qa-email regarding python guidelines, which allows to import the script content in another script (for unit testing purpose for example) Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-05-31config.json: Switch alma8/stream8/opensuse to use full buildtoolsSteve Sakoman
Also drop centos8 as we don't test that now. Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-01-13config.json: Set BB_NUMBER_PARSE_THREADSRichard Purdie
Currently we use 56 or 24 cores on the various workers but this is pulling machines over with OOM issues, particularly in oe-selftest. Lower the parallelism for parsing to try and help avoid this as we don't really need maximum speed for parsing on the autobuilder. Keep the same numbers for the perf workers as we want to use all cores there. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-11-10config.json: use meta-agl master branch rather than next branchSteve Sakoman
kirkstone is no longer supported on the next branch Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-09-04config.json: Set SDKMACHINE to aarch64 for oe-selftest-armhostRoss Burton
Although bitbake.conf sets the default SDKMACHINE to the build architecture, config.json resets that to i686. As oe-selftest assumes that the SDKs it builds are usable on the host machine, we should set SDKMACHINE=aarch64 in the oe-selftest-armhost build. A follow-up more invasive patch to clean up the SDKMACHINE assignments is in progress, once it has been verified to not cause regressions. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 65281a56452cf2bc547c60c0b2131422ab48a3d2) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-08-30scripts/archive_buildstats: Exit early if buildstats isn't presentRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-08-30scripts/archive_buildstats.py: archive buildstats to tar.zstAryaman Gupta
Archive the buildstats of every failed build and 1% of random builds. Convert the time-stamped buildstats directory to a compressed tarball using the hostname as a prefix (to the file name only) so that one can identify the source machine. Move these tarballs to the directory: testresults/<build_name>/buildstats/ The archiving is performed during the "collect results" step. Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com> Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-08-30config.json: enable CPU and IO pressure regulationAryaman Gupta
Prevent severe system overload by setting the pressure limits for CPU and IO at 10000. Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com> Signed-off-by: Randy Macleod <Randy.Macleod@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-15config.json: update to dedicated domainMichael Halstead
A dedicated domain for hashserv allows us to move it to dedicated infrastructre. Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-20config.json: use buildtools for opensuse154Steve Sakoman
Getting failures due to make version 4.2.1 Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-15config.json: Simplify sstate structureRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-14config.json: Apply make fix for perf-alma8 tooRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-14Add make tarballs for affected workersRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-11config.json: move kirkstone sstate to its own directorySteve Sakoman
Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-07config.json: rewrite meta-virt build stepsRoss Burton
In the meta-virt builder, don't do a world build but instead build just xen-image-minimal for both qemuarm64 and qemux86-64. This can be expanded over time, but is a sensible starting point and builds cleanly. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-06config: Add buildperf-alma8Michael Halstead
Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
2022-03-31config.json: Add kirkstone mappingRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-22scripts/run-docs-build: Support auto generation of switchers.js and poky.yamlRichard Purdie
This uses the set_versions.py script from the docs master branch to handle creation of the swictchers.js version information as well as the data in poky.yaml. This allows patches to those sections of the docs to be dropped. It is assumed the patch to use set_versions is applied to the docs transitions branch so that it's switchers.js files no longer need to be tweaked. This does lead to user visible changes on the website: - Older versioned released docs gain their current version and the latest version listed in the switcher rather than being unlisted - The list of releases is normally filtered down to our active ones (hardknott, honister and dev right now) - 3.3's doc references to gatesgath are corrected to hardknott - Docs for unversioned release branches (not linked on the website) now use 3.1.999 versioning instead of confusing them with the last relased version - 3.1.13 refers to 3.1.13 instead of 3.1.12 all of which seem to be reasonable improvements. The big advantage of these changes is that with a single change to the script in the master branch, the right thing should happen for all the current docs and at release time, only a docs rebuild should need to be triggered after tags are pushed. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: factor out yocto-docs tags and branches buildingQuentin Schulz
Except patching which is specific to tags and yocto- tag prefix stripping, the logic is identical, so let's merge both loops together. Cc: Quentin Schuls <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: simplify sphinx-buildable yocto-docs tag list fetchingQuentin Schulz
The commit that introduced Sphinx support in yocto-docs is 01dd5af7954e24552aca022917669b27bb0541ed. Any tag containing this commit is buildable by sphinx. Dunfell tags don't all have Sphinx support. However, all tags containing the introducing commit c25fe058b88b893b0d146f3ed27320b47cdec236 are buildable by sphinx. Therefore, let's just list all tags which contains either of those two commits instead of the complex series of pipes and shell commands. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: automatically build new yocto-docs branchesQuentin Schulz
Since commit 01dd5af7954e24552aca022917669b27bb0541ed, all later releases of yocto-docs can be built with Sphinx. Instead of manually updating this list, let's have git return the list of remote branches which contains the commit. dunfell branch was initially released without Sphinx support but was later patched, hence why it's explicitly listed. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: factor out all yocto-docs branches buildingQuentin Schulz
master, master-next and transition only differ from other branches by their output directory name. Let's put everything in common and only have a check on whether the branch is master, master-next or transition and modify the output dir in those cases. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: automatically build new Bitbake branchesQuentin Schulz
Since commit 84ccba0f4aff91528f764523fe1205a354c889ed, docs of all later releases can be built with Sphinx. Instead of manually updating this list, let's have git return the list of remote branches which contains this commit. 1.46 branch was initially released without Sphinx support but was later patched, hence why it's explicitly listed. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: factor out all bitbake branches buildingQuentin Schulz
master and master-next only differ from other branches by their output directory name. Let's put everything in common and only have a check on whether the branch is master or master-next and modify the output dir in those cases. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15Revert "scripts: run-docs-build: do not turn sphinx warnings into errors"Quentin Schulz
The patch was meant as a quick temporary work-around to have the docs built and published. Now that releases where -W flag is set (turning warnings into errors) are appropriately patched to make those warnings disappear (on Sphinx v3.2.1 which is the one used on the builder), this patch can be reverted so that next time a warning appears the doc building will fail but will not destroy the doc website (because of commit 6a4e6ef18d1415c719be51c773d7c57cae5549cf "scripts: run-docs-build: make the script fail hard ASAP when there's an error", since rsync will not be run if any error happens before). This reverts commit 931d409b255a85f2217ca093d8391a678ce00ddb. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15scripts: docs-build-patches: fix incorrect conf.py for yocto-3.4.1Quentin Schulz
The patch was missing from yocto-3.4.1 release and only made it to yocto-3.4.2 unfortunately so let's backport it. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15scripts: docs-build-patches: fix bitbake objects.inv being usedQuentin Schulz
Each Yocto Project release is validated for a specific Bitbake release. By mistake, most release docs are pointing at the development branch of Bitbake documentation instead of the one that was validated for the Yocto Project release. This fixes the issue by patching the conf.py of impacted releases. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15scripts: run-docs-build: simplify patching logicQuentin Schulz
There's no need to keep a list of tags requiring to be patched since the tag is part of the path where patches are stored. Therefore, let's only check if there's a patch directory for a given tag and if so, apply all patches in there. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15oe-build-perf-report-email: Drop phantomjs email generation supportRichard Purdie
This approach didn't work reliably so switch to text based emails pointing at the website version with graphs and data. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15scripts/build-perf-test-wrapper: Update to only send text based emailsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15clobberdir: Only function if the target trash directory existsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15config: Add buildperf-debian11Richard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-03auh-config: update smtp server to localhostAlexander Kanavin
Current setup only allows sending mail via localhost on alma workers. Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-02scripts: run-docs-build: patch releases with incorrect current versionMichael Halstead
Add patch for version 3.3.5 and move patches into a dedicated subdirectrory to keep the scripts directory tidy. Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>