aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2022-05-23scripts/patchmetrics-update: Fix typoRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-23scripts/run-patchmetrics: Ensure tmpdir is clean between build runsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-23scripts: Add patch to filter the chart data to make it usableRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-23scripts/run-patchmetrics: Ensure environment works for dunfellRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-23scripts: Extend CVE testing to kirkstone and dunfell branchesRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-23scripts: Add ability to add/process missing patch stats dataRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-17run-patchmetrics: Add very basic cve-check functionalityRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-17Add license fileRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-17Clarify license and copyright informationRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-17gitignore: Ignore __pycache__ directoriesRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-13run-patchmetrics: Use -m for realpath for results dir as it doesn't existRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-13run-patchmetrics: Use full variable namesRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-13config.py: Split bring up into a template and add a fast versionRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-13scripts/run-patchmetrics: Ensure paths are sanitizedRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-13config/scripts: Allow publishing of patch metricsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-13config/scripts: Add initial patch metric tracking codeRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-13config/run-config: Allow other OE-Core machines to be tested manuallyRichard Purdie
These are not part of our standard testing but allow them to be triggered manually to assess their status. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-29config.json: also build meta-virt for qemuarmRoss Burton
Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-26scripts/run-docs-build: Use set-versions.py to get the latest release branch ↵Richard Purdie
name The intent here is to use the latest release branch name instead of a tagged version. For the 4.0 case, this means the full migration guide will be shown instead of the reduced information in the 4.0 tag. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-25config.json: centos7 and ubuntu1604 perf workers are being decommissoned, removeRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-20scripts: run-docs-build: reuse logic to link to latest tagQuentin Schulz
Since the latest tag already has a specific handling in the forloop, let's just move the symlink creation inside the forloop. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-20scripts: run-docs-build: make latest documentation tag the default versionQuentin Schulz
Currently, the master branch is the default branch being displayed by default when reaching the Yocto docs website. When big changes are implemented for the next release, these are shown immediately to the user, even though there is currently no release available for those changes. This is an issue when e.g. behaviors are changed, new features are added, variables get renamed or some syntaxes change because the user might try to use things that aren't available to them yet. I believe more people are using released version of Yocto Project/Bitbake than people working on latest master. So let's make the default version of the docs the latest tag (in terms of version number, not date of tagging) to avoid too much confusion. The master branch of the docs is now available at /dev subpath. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-19scripts: run-docs-build: use set_versions.py and switchers.js.in from masterQuentin Schulz
set_versions.py and switchers.js.in need to be up-to-date so that a consistent behavior is kept between different branches and tags of the documentation. Right now, kirkstone branch is lagging behind master and therefore does not have the latest changes from master (e.g. the new obsolete algorithm, which obviously isn't an issue right now, but will be in two years). Using master version for those scripts also lightens the maintenance burden. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-19scripts: run-docs-build: add option to skip upstream rsyncQuentin Schulz
The rsync only makes sense for the Autobuilder as most people don't have access to docs@docs.yoctoproject.org. Therefore, to allow for easier contribution to this script, let's allow to skip the rsync so the script can continue to run. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-19scripts: run-docs-build: allow to pass buildtools script and docbook tarball ↵Quentin Schulz
paths Currently, the path to buildtools script and docbook tarball are hardcoded to work on Yocto Project Autobuilder. However, this makes it harder to contribute to this script because it is very unlikely those paths exist on a developer PC. Instead, let's allow to override variables by using the environment and make the current hardcoded values the default ones. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-19scripts: run-docs-build: transform argument paths into absolute pathsQuentin Schulz
The script is written in such a way that absolute paths are expected. Instead of failing weirdly at some point in the script, let's just make all paths passed to this script absolute by calling realpath on them. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-14config.json: Apply make fix for perf-alma8 tooRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-14Add make tarballs for affected workersRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-11config.json: no need to explicitly exclude the NPM testsRoss Burton
These tests now skip themselves automatically[1] if meta-oe isn't present, so there is no need to explicitly skip them. [1] oe-core d22ed015d8f38241acb783e1a468fb15d4317670 Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-07config.json: rewrite meta-virt build stepsRoss Burton
In the meta-virt builder, don't do a world build but instead build just xen-image-minimal for both qemuarm64 and qemux86-64. This can be expanded over time, but is a sensible starting point and builds cleanly. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-06config: Add buildperf-alma8Michael Halstead
Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
2022-03-31config.json: Add kirkstone mappingRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-22scripts/run-docs-build: Support auto generation of switchers.js and poky.yamlRichard Purdie
This uses the set_versions.py script from the docs master branch to handle creation of the swictchers.js version information as well as the data in poky.yaml. This allows patches to those sections of the docs to be dropped. It is assumed the patch to use set_versions is applied to the docs transitions branch so that it's switchers.js files no longer need to be tweaked. This does lead to user visible changes on the website: - Older versioned released docs gain their current version and the latest version listed in the switcher rather than being unlisted - The list of releases is normally filtered down to our active ones (hardknott, honister and dev right now) - 3.3's doc references to gatesgath are corrected to hardknott - Docs for unversioned release branches (not linked on the website) now use 3.1.999 versioning instead of confusing them with the last relased version - 3.1.13 refers to 3.1.13 instead of 3.1.12 all of which seem to be reasonable improvements. The big advantage of these changes is that with a single change to the script in the master branch, the right thing should happen for all the current docs and at release time, only a docs rebuild should need to be triggered after tags are pushed. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: factor out yocto-docs tags and branches buildingQuentin Schulz
Except patching which is specific to tags and yocto- tag prefix stripping, the logic is identical, so let's merge both loops together. Cc: Quentin Schuls <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: simplify sphinx-buildable yocto-docs tag list fetchingQuentin Schulz
The commit that introduced Sphinx support in yocto-docs is 01dd5af7954e24552aca022917669b27bb0541ed. Any tag containing this commit is buildable by sphinx. Dunfell tags don't all have Sphinx support. However, all tags containing the introducing commit c25fe058b88b893b0d146f3ed27320b47cdec236 are buildable by sphinx. Therefore, let's just list all tags which contains either of those two commits instead of the complex series of pipes and shell commands. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: automatically build new yocto-docs branchesQuentin Schulz
Since commit 01dd5af7954e24552aca022917669b27bb0541ed, all later releases of yocto-docs can be built with Sphinx. Instead of manually updating this list, let's have git return the list of remote branches which contains the commit. dunfell branch was initially released without Sphinx support but was later patched, hence why it's explicitly listed. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: factor out all yocto-docs branches buildingQuentin Schulz
master, master-next and transition only differ from other branches by their output directory name. Let's put everything in common and only have a check on whether the branch is master, master-next or transition and modify the output dir in those cases. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: automatically build new Bitbake branchesQuentin Schulz
Since commit 84ccba0f4aff91528f764523fe1205a354c889ed, docs of all later releases can be built with Sphinx. Instead of manually updating this list, let's have git return the list of remote branches which contains this commit. 1.46 branch was initially released without Sphinx support but was later patched, hence why it's explicitly listed. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-18scripts: run-docs-build: factor out all bitbake branches buildingQuentin Schulz
master and master-next only differ from other branches by their output directory name. Let's put everything in common and only have a check on whether the branch is master or master-next and modify the output dir in those cases. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15Revert "scripts: run-docs-build: do not turn sphinx warnings into errors"Quentin Schulz
The patch was meant as a quick temporary work-around to have the docs built and published. Now that releases where -W flag is set (turning warnings into errors) are appropriately patched to make those warnings disappear (on Sphinx v3.2.1 which is the one used on the builder), this patch can be reverted so that next time a warning appears the doc building will fail but will not destroy the doc website (because of commit 6a4e6ef18d1415c719be51c773d7c57cae5549cf "scripts: run-docs-build: make the script fail hard ASAP when there's an error", since rsync will not be run if any error happens before). This reverts commit 931d409b255a85f2217ca093d8391a678ce00ddb. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15scripts: docs-build-patches: fix incorrect conf.py for yocto-3.4.1Quentin Schulz
The patch was missing from yocto-3.4.1 release and only made it to yocto-3.4.2 unfortunately so let's backport it. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15scripts: docs-build-patches: fix bitbake objects.inv being usedQuentin Schulz
Each Yocto Project release is validated for a specific Bitbake release. By mistake, most release docs are pointing at the development branch of Bitbake documentation instead of the one that was validated for the Yocto Project release. This fixes the issue by patching the conf.py of impacted releases. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15scripts: run-docs-build: simplify patching logicQuentin Schulz
There's no need to keep a list of tags requiring to be patched since the tag is part of the path where patches are stored. Therefore, let's only check if there's a patch directory for a given tag and if so, apply all patches in there. Cc: Quentin Schulz <foss+yocto@0leil.net> Signed-off-by: Quentin Schulz <quentin.schulz@theobroma-systems.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15oe-build-perf-report-email: Drop phantomjs email generation supportRichard Purdie
This approach didn't work reliably so switch to text based emails pointing at the website version with graphs and data. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15scripts/build-perf-test-wrapper: Update to only send text based emailsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15clobberdir: Only function if the target trash directory existsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-15config: Add buildperf-debian11Richard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-03auh-config: update smtp server to localhostAlexander Kanavin
Current setup only allows sending mail via localhost on alma workers. Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-02scripts: run-docs-build: patch releases with incorrect current versionMichael Halstead
Add patch for version 3.3.5 and move patches into a dedicated subdirectrory to keep the scripts directory tidy. Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
2022-03-01auh-config: correct LICENSE_FLAGS variableAlexander Kanavin
Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>