aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2023-09-27scripts/send_qa_email: Add missing global to allow exitcode to workRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-26scripts/send-qa-email: Add URL of build to QA emailRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-26qa_email: Ensure we set an error exit code for errorsRichard Purdie
Whilst the script needs to continue if we fail to generate a regression report, set the exit code accordingly so our CI can flag the issue. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-26qa_email: Add headers to the script to improve debuggingRichard Purdie
It is hard to tell which section of the code specific error messages come from at present. Add more headers to the output so we can at least tell which section the messages are from. It also adds some timing information. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-07config.json: Drop most core-image-minimal-dev image tests and add ↵Richard Purdie
core-image-full-cmdline Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-07config.json: Consolodate oecore test stepsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-07config.json: Drop now unneeded SDKMACHINE settingsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-07config.json: Prefer x86_64 SDKMACHINE to i686Richard Purdie
The i686 SDKMACHINE target makes little sense now, reduce it's usage substantially to match use in reality and make x86_64 the default. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-07config.json: Set SDKMACHINE explicitlyRichard Purdie
SDKMACHINE defaults to i686 for historical reasons but it should no longer be the main thing we test. Start to improve things by setting things by everywhere explicitly so we can then rationalise to what makes sense. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-07config.json: Reduce testing on qemumips/qemumips64/qemuppcRichard Purdie
Introduce the concept of "qemu lite" and reduce the testing on these platforms, mainly with the removal of core-imaege-sato-sdk. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-09-06config.json: add generic-arm64/poky-altcfg buildRoss Burton
We want to promote generic-arm64 to meta-yocto-bsp in the future, so start testing this more comprehensively. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-08-15auh-config: systemd now requires usrmergeAlexander Kanavin
Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-08-10config.json: systemd now requires usrmergeRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-26scripts/test_utils.py: update test after BUILD_HISTORY_DIRECTPUSH removalAlexis Lothoré
Update getcomparisonbranch unit tests by removing BUILD_HISTORY_DIRECTPUSH entry in fake configuration Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-26config.json: remove BUILD_HISTORY_DIRECTPUSHAlexis Lothoré
Now that BUILD_HISTORY_DIRECTPUSH has been replaced by a hardcoded condition, remove it from config.json Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-26scripts/utils.py: replace BUILD_HISTORY_DIRECTPUSH with hardcoded conditionAlexis Lothoré
It has been observed that when a new release branch is created, it is quite easy to forget to update the BUILD_HISTORY_DIRECTPUSH variable, which leads to failures in autobuilder like test results not being pushed. Replace the BUILD_HISTORY_DIRECTPUSH usage with a hardcoded condition which validates any branch in poky representing a "main" branch, i.e all branches not ending in "-next" Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-15ab-janitor: only rm trashdir files over 60s oldTrevor Gamblin
[YOCTO #14952] -- https://bugzilla.yoctoproject.org/show_bug.cgi?id=14952 Help avoid contention by adding a check to ensure files and directories are at least 60s old when attempting to delete them from the trashdir, in case bitbake or another process is still actively using them. Signed-off-by: Trevor Gamblin <tgamblin@baylibre.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-14config.json: add mickledore as direct push branch for test resultsAlexis Lothoré
Now that mickledore is released, builds are executed on mickeldore release branch. If not properly described in config.json, it will be considered a "work" branch, and as a consequence test results will not be pushed onto test results git repository Add mickeldore entry in config.json to fix test results storage Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-14scripts/send-qa-email: print warning when test results are not storedAlexis Lothoré
Tests results push command depends on basebranch and comparebranch variables, which are computed based on config.json content. If this file is not in sync with current release branch, tests results will be properly stored in git directory but not pushed onto test results server. Since we are able to detect this scenario, print at least a warning, without breaking current build since it could be a release Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-14scripts/send-qa-email: use logger instead of raw printsAlexis Lothoré
As for other scripts in yocto-autobuilder-helper or oecore, use python logger class instead of raw print calls to allow log level distinction Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-13Add meta-clang buildersRoss Burton
Add a meta-clang builder that runs testimage on core-image-sato-sdk for both qemux86-64 and qemuarm64, and add meta-clang to the nightly check-layer builder. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-13config.json: remove redundant oe-selftest-arm builderRoss Burton
This builder isn't run regularly, and is redundant now that oe-selftest-armhost uses MACHINE=qemuarm64. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-13scripts/layer-config: remove unused importsRoss Burton
Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-08config.json: Separate out toolchain targetsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-08config.json: Update non-rpm targets to improve coverageRichard Purdie
The "non-rpm" tests were not covering our builds particularly well and wasting build resources. Update the tests to drop the "deb on rpm" and "rpm on deb" targets which never really find issues. Replace them with one set of good x86 and arm tests for both ipk and deb, adding in SDK testing to the mix as well. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-06-08config.json: Switch from qemux86 to qemux86-64 for general targetsRichard Purdie
Most users are using 64 bit x86 now, update our remaining configuration defaults to reflect that. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-05-10scripts/publish-artefacts: remove all reference to deprecated edgerouterMichael Halstead
edgerouter is no longer part of meta-yocto so we removed it from the autobuilder configuration as well. Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-05-04auh: publish output on https://autobuilder.yocto.io/pub/auh/Alexander Kanavin
AUH itself already has an option to include the link into its email reports; the option just needs to be enabled. [YOCTO #15103] Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-05-03config.json: meta-aws needs meta-multimedia now, for checklayer as wellThomas Roos
Signed-off-by: Thomas Roos <throos@amazon.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-04-14config.json: meta-aws needs meta-multimedia nowRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-04-11run-patchmetrics: Add mickledoreRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-04-01cve-generate-chartdata: Fix syntax errorRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-31cve-generate-chartdata: Fix indentationRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-31cve-generate-chartdata: Exclude linux-yocto for old release branches for nowRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-29cve-report: Drop linux-yocto exclusionRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-24scripts/generate-testresult-index.py: expose regression reports on web pageAlexis Lothoré
When available, expose tesresult-regressions-report.txt on non-release web page, as it is done for many other artifacts currently Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-24scripts/generate-testresult-index.py: fix typo in template var nameAlexis Lothoré
Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-23scripts/send_qa_email: return previous tag when running a non-release master ↵Alexis Lothoré
build Some nightly builders are configured in yocto-autobuilder2 to run master builds. Those build parameters currently skip all branches of get_regression_base_and_target, which then return None, while the caller expects a base and target tuple Set default behaviour to return previous tag as comparison base and passed branch as target for such builds Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-23scripts/test_send_qa_email.py: allow tests with non static resultsAlexis Lothoré
When the test assert is about a tag in Poky, the result will not be the same depending on existing tags at the time of running tests. Add a LAST_TAG marker to loosen constraints but still allow to tests for general cases (e.g. : test that tag-depending tests does not return None) Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-23scripts/test_utils: test master nightly build caseAlexis Lothoré
Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-21config.json: fix A. Belloni configuration for regression reportingAlexis Lothoré
There is a typo in BUILD_HISTORY_FORKPUSH, leading to failures on Autobuilder when trying to generate regression reports: Traceback (most recent call last): File "/home/pokybuild/yocto-worker/a-full/yocto-autobuilder-helper/scripts/send-qa-email", line 213, in <module> send_qa_email() File "/home/pokybuild/yocto-worker/a-full/yocto-autobuilder-helper/scripts/send-qa-email", line 117, in send_qa_email basebranch, comparebranch = utils.getcomparisonbranch(ourconfig, repo, branch) File "/home/pokybuild/yocto-worker/a-full/yocto-autobuilder-helper/scripts/utils.py", line 392, in getcomparisonbranch comparerepo, comparebranch = base.split(":") ValueError: not enough values to unpack (expected 2, got 1) Observed on build a-full/5070 Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-20config: flag A. Belloni master-next branch as testing branchAlexis Lothoré
Add "abelloni/master-next" branch from poky-contrib in configuration so that regression reports are generated when testing for patches Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-20scripts/test_send_qa_email.py: add tests for base/target pair guessingAlexis Lothoré
Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-20scripts/send-qa-email: fix testing branches regression reportingAlexis Lothoré
d6018b891a3b7c62c7a2883c7fb9ae55e66f1363 broke regression reporting for testing branches (e.g: master-next in poky, ross/mut in poky-contrib) by ignoring the comparebranch returned by utils.getcomparison branch Fix regression reporting for those branches by using comparebranch again. The fix also refactor/add a intermediary step to guess base and target for regression reporting, to isolate a bit the logic and make it easier later to add multiple base/target couples Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-20scripts/send-qa-email: add tests for is_release_versionAlexis Lothoré
Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-20scripts/send-qa-email: protect is_release_version from None valueAlexis Lothoré
Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-20scripts/send-qa-email: invert boolean logic for release checkAlexis Lothoré
is_non_release_version has an inverted logic which makes its reuse quite confusing Transform it as is_release_version and let caller do the negation if needed Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-20scripts/send-qa-email: remove unused variableAlexis Lothoré
Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-20scripts/utils: add unit tests for getcomparisonbranchAlexis Lothoré
Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-03-08scripts/send-qa-email: use yocto_testresults_query.py for sha1 resolutionAlexis Lothoré
A new tool named yocto_testresults_query.py has been integrated in poky as a thin wrapper between send-qa-email and resulttool. The new tool is in charge of converting tags/branches names to SHA1 revisions and to call resulttool with those revisions Remove any code related to tag/branches conversions to SHA1 and use yocto_testresults_qery.py instead Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
generated by cgit 1.2.3-korg (git 2.39.0) at 2024-05-25 14:37:34 +0000