aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2 hoursconfig.json: don't do SDK tests on fvp-baseHEADscarthgapmasterRoss Burton
There's very little to be gained by doing SDK tests for fvp-base, so save some cycles by removing them. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2 hoursconfig.json: remove generic-arm64 from meta-armRoss Burton
This machine has been removed from meta-arm now that genericarm64 is in meta-yocto-bsp. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
14 hourscve-generate-chartdata: Handle unexpected files in the stats directoryRichard Purdie
A build of "stable/dunfell-nut" caused incorrect data to be added to the metrics repo and resulted in script failures. Handle this situation better. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
17 hoursscipts/run-patchmetrics: Copy metric data recursively to fix failuresRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
34 hoursgenerate-chartdata: do not create lastyear json fileshulkoba
the two html files, index.html and index-full.html, got merged so we only need the json file with the complete set of data. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
34 hourscve-report: Reformat txt recipe list per branchNinette Adhikari
Yocto gathers the amount of CVEs per branch at the top of their metrics view. However, the presentation of this information is not descriptive enough and it’s spread across several files. This change adds collapsible, nested lists to show all cve information. Show current CVE count per release, parse txt files with CVE lists to group them by project and display their total CVE count. Inline this data on the matrics-page in details elements so there’s no need to navigate away. The current output includes the count of cve's and the cve-urls. No data is lost here, it looks like: CVE counts by recipes: linux-yocto: 134 https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-1999-0524 https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-1999-0656 ... bluez5: 2 https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2022-3563 https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2022-3637 ... Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 daysconfig.json: Pull in pip addition and curl fix for buildtoolsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
10 daysconfig.json: Update to buildtools with setuptools in itRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
11 daysconfig.json: Switch to a newer buildtools with websockets inRichard Purdie
We're now using websockets for the hash equivalence server. Switch to a buildtools tarball which contains it. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-04-12config.json: point hashserv to v2 location with websocketsMichael Halstead
Enable new bitbake hashserv infrastructure. Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
2024-04-11scripts/layer-parser: sort maintainers for better displayMichael Halstead
Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
2024-03-28README: update patch submission addressRoss Burton
Patches should now be sent to yocto-patches@. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-13config.json: metrics: Switch to daily CVE DB full-downloadYoann Congal
By using CVE_DB_INCR_UPDATE_AGE_THRES = CVE_DB_INCR_UPDATE_AGE_THRES = 6h, cve-check will do a NVD database full download if the database is older than 6h or reuse it un-updated if its younger than 6h. Since the metrics builder is scheduled every day, that will result in a daily full-download. That will workaround NVD API limitations were some updates may be missed and the incrementaly updated database is not equivalent to a freshly downloaded database. Signed-off-by: Yoann Congal <yoann.congal@smile.fr> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-07scripts/abint: fix sorting on initial displayRoss Burton
The default sorting was based on the list of seen times, but it should be based on the latest seen time. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-07scripts/abint: add argument parserRoss Burton
Add an argument parser so that the use of the cache or verbose logging can be enabled/disabled without having to edit the source code. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-07scripts/abint: sort and organise importsRoss Burton
Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-07run-config/config.json: Add support for installing extra tools for specific ↵Richard Purdie
targets Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-05publish-artefacts: publish genericarm64 imagesRoss Burton
Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-05config.json: Switch poky-altcfg to use ipk as the package backendRichard Purdie
Since we plan to have better "binary distro" testing on the autobuilder and we plan to primarily use ipk for this, having ipk based images available as part of our builds is desireable. Since we want systemd based images with ipk, it makes sense to leave standard poky using rpm images but switch poky-altcfg to use ipk. Whilst late in the release cycle, doing this now for scarthgap gives us a good platform to build off in the long term too. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-04config.json: meta-oe-repro: fix meta-networking -> meta-python dependencyYoann Congal
Since [0], meta-networking depends on meta-python. So, add meta-python layer wherever meta-networking is used. [0]: https://git.openembedded.org/meta-openembedded/commit/?id=ab7c469bfeb7aba97402d8eab03d9bb18725c6af Signed-off-by: Yoann Congal <yoann.congal@smile.fr> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-04config.json: meta-oe-repro: exclude packages that failed previouslyYoann Congal
Those are the non-reproducible packages from: https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/13 https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/14 Only somewhat innocuous non-repro are added to OEQA_REPRODUCIBLE_EXCLUDED_PACKAGES (compile date in package, TMPDIR path, ...). Actual non-repros were not excluded : * drbd-utils: a udev rule is either enabled or disabled * apache2: a index.html is present or not in the package * toybox-inittab: a getty is started or not on serial ports Signed-off-by: Yoann Congal <yoann.congal@smile.fr> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-04config.json: Drop obsolete distros from master configRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-28config.json: Add genericarm64 supportRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-21config.json: Add BB_LOADFACTOR_MAX settingRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-19config.json: meta-oe-repro: exclude python3-pandas* from repro testYoann Congal
Exclude python3-pandas{,-src,-dbg} from reproducible tests as these look non-reproducile for now[0][1]. [0]: https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/12/steps/40/logs/stdio [1]: https://autobuilder.yocto.io/pub/repro-fail-openembedded/meta-python/oe-reproducible-20240217-j7swf3az/packages/diff-html/ Signed-off-by: Yoann Congal <yoann.congal@smile.fr> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-18Add bitbake-extra-tests to cover taskexp ncurses UI.Richard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-15config.json: Fix exein repo nameRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-15scripts/abint: add a footer showing when the report was generatedcontrib/ross/masterRoss Burton
Signed-off-by: Ross Burton <ross.burton@arm.com>
2024-02-13config.json: meta-oe-repro: exclude packages that failed previouslyYoann Congal
Those are the non-reproducible packages from: https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/11 NB: I've not looked too much at the list. At least an element is weird: samba-dbg being non-reproducible in meta-xfce but reproducible in meta-networking? Signed-off-by: Yoann Congal <yoann.congal@smile.fr> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-09generate-testresult-index: fix key generation when filenames have hyphensRoss Burton
This script generates sorting keys so that 20240201-4 sorts before 20240201-20, but the code assumes that there is only one hyphen when it splits. However, there is now a patchstatus-meta-oe directory, which causes the script to throw an exception. Before padding, use a regex to check that the key is of the format we expect, that is two integers separated by a hyphen. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-09Add an AB-INT reportRoss Burton
This report visualises the AB-INT bugs over time, to help find trends such as bugs which are no longer occuring, or bugs which should be fixed urgently. Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-08config.json: Try allowing a bit more parallelismRichard Purdie
Currently the autobuilders seem to run at 25% idle at times. We see a lof of bouncing on IO load and it appears the systems could cope with higher values. Increase the make load average, cpu and IO pressure limits a bit to see if build times improve. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-08config.json: Add meta-exein compatibility testingRichard Purdie
Add meta-exein yocto-check-layer testing. Due to HOSTTOOLS issues, we need to had a horrible hack. v2 compatibility doesn't test for HOSTTOOLS changes although perhaps the next version might. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-08README: Add a "git send-email" example for contributingYoann Congal
This "git send-email" example is present in most Yocto/OE repos and is quite useful for a quick copy/paste. Signed-off-by: Yoann Congal <yoann.congal@smile.fr> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-08README: Fix "subjectprefix" git configYoann Congal
The fixed config does match what all other lists do: [yocto-autobuilder-helper][PATCH vX] XXX Signed-off-by: Yoann Congal <yoann.congal@smile.fr> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-08config.json: reproducible-meta-oe: re-include ibus in repro testsYoann Congal
Since [0], ibus should be reproducible. So, re-enable it in reproducibility tests. [0]: https://git.openembedded.org/meta-openembedded/commit/?id=0ffbe2a79a5d49b2719c934ca0e73822fa3cbc2e Signed-off-by: Yoann Congal <yoann.congal@smile.fr> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-08config.json: reproducible-meta-oe: exclude crossguidYoann Congal
Remove crossguid from reproducibility test: it packages a file containing a full TMP path: WARNING: crossguid-0.2.2-r0 do_package_qa: QA Issue: File /usr/share/crossguid/cmake/crossguid-config.cmake in package crossguid contains reference to TMPDIR [buildpaths] Signed-off-by: Yoann Congal <yoann.congal@smile.fr> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-07run-config: log the contents of bblayers.conf after editsRoss Burton
This is useful when using large sets of layers to verify that the right layers have been added in the right order. Signed-off-by: Ross Burton <ross.burton@arm.com>
2024-02-07run-config: generalise auto.conf logging and only show when changedRoss Burton
Extract the logging of auto.conf to a new log_file_contents() function, and instead of calling it before _every_ call of bitbake, only show it when actually writing the auto.conf. Signed-off-by: Ross Burton <ross.burton@arm.com>
2024-02-01layer-config: Allow layer add to be disabled on a per target basisRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-01-30config.json: run CDN population tasks with --runall buildcontrib/akanavin/misc-fixesAlexander Kanavin
There was a report of missing go-cross:populate_sysroot here: https://autobuilder.yoctoproject.org/typhoon/#/builders/83/builds/6504/steps/23/logs/stdio The builds that are expected to create the object (or take it from cache) are: https://autobuilder.yoctoproject.org/typhoon/#/builders/42/builds/8481/steps/12/logs/stdio https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8457/steps/25/logs/stdio and neither mentioned that task anywhere, instead going directly to go-helloworld's rpm. This means that go-cross can be neither taken from cache not written into it in a-full, and we need '--runall build' to ensure it's not skipped over. I also took the opportunity to match up the target image names with what the CDN test actually checks. Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-01-23cve-report: Add summary counts of CVEs by recipeRichard Purdie
It is often helpful to know how many CVEs are open against a given recipe. Add a summary table of this to the end of the CVE listing. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-01-20config.json: set ROOT_HOME to /root for sysvinit with systemdChen Qi
For sysvinit with systemd, the systemd package will still be build. This gives us a warning like below: WARNING: systemd-1_255.1-r0 do_install: Using /home/root as root user's home directory is not fully supported by systemd Set ROOT_HOME to "/root" to avoid such warning. Note that when using sysvinit as the init manager, /home/root is totally valid, it's just that 'systemd' being in DISTRO_FEATURES causes systemd to be built. So the only purpose of this patch's is to avoid warnings on autobuilders. Signed-off-by: Chen Qi <Qi.Chen@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-01-02config.json: Fix syntax errorsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-01-02config.json: use INIT_MANAGERChen Qi
The default INIT_MANAGER is 'sysvinit', to use systemd as the init manager, we use INIT_MANAGER = 'systemd' because we can make use of the settings in conf/distro/include/init-manager-systemd.inc. Signed-off-by: Chen Qi <Qi.Chen@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-01-02config.json: Match the machine spec to task for rv32 qemu jobsKhem Raj
Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-01-02scripts: send_qa_email: add dry-run modeAlexis Lothoré
Add a dry-run mode to be able to run send_qa_email locally but disabling any output (no commit or tag pushed upstream, no mail sent). This eases all release-related debugging. This dry-run mode is enabled by the following changes: - add a -d/--dry-run parameter to send_qa_email - update test_results url to allow cloning test_results repository without having its public key registered upstream - skip test results storage - do not erase test results temp dir - skip email sending (but still generate it) Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-12-21scripts/release-parser.py: download latestMichael Halstead
Download links need to point to the latest point release. Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
2023-12-21scripts/release-parser.py: correct stable versionMichael Halstead
Update from mickledore to nanbield. Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
2023-12-17scripts: send_qa_email: protect get_regression_base_and_target from exceptionsAlexis Lothoré
generate_regression_reports is currently protect in a try/catch block to prevent it from canceling QA email generation when encountering an issue, but get_regression_base_and_target is not. Make sure that get_regression_base_and_target can not prevent QA email from being generated by adding it to the try/catch block protecting send_qa_email. While doing so, make sure to preserve the exitcode variable to make sure that the step is still marked as fail in autobuilder to make sure the error does not go silent. However the variable is not needed as global anymore since it is now used in a single function. Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
generated by cgit 1.2.3-korg (git 2.39.0) at 2024-04-26 23:24:20 +0000