summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2022-03-31oeqa/selftest: generalise test_devtool_virtual_kernel_modifyross/selftestRoss Burton
Generalise this test so that it works on more than qemux86-64: - Don't edit a file in arch/x86 to cause a rebuild, instead use init/ - Look for the edits in the build tree, as the deployed kernel could be of any type (zImage/bzImage/etc) and edits may be in the compressed part. Also remove redundant checks on the result of runCmd(), as this will raise AssertionError exceptions itself so the explicit asserts will never trigger. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/wic: use self.td instead of get_bb_var to save on bitbake callsRoss Burton
When a test case starts, self.td is populated with all the variables in the data store. Typically this can be used instead of get_bb_var(), which saves a bitbake call per variable lookup. The only catch is that in parallel runs the build directory is moved after td is populated, so paths in the build directory are wrong: these still need to be fetched in the test. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/wic: use os.path.join to join pathsRoss Burton
Instead of using string concatenation, use os.path.join. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/wic: rearrange testsRoss Burton
Split the tests into further classes: one which exercises the CLI and doesn't need to build images at all, and another which is just the tests that manipulate existing images. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/wic: cleanup WicTestCase.setUpLocalRoss Burton
Use os.path.join to construct paths, and invoke bitbake once instead of three times. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/oescripts: refactor skipping logicRoss Burton
OEScriptTests currently skips if cairo isn't present, and does a build of core-image-minimal. This is only required for the OEPybootchartguyTests tests, so move that logic there so that the OEListPackageconfigTests run even if cairo isn't available. This leaves OEScriptTests as a simple class containing the scripts_dir assignment, which can then be reused by other tests to avoid code duplication. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa: rationalise skipifqemu decoratorsRoss Burton
Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest: tag tests that use runqemuRoss Burton
There may be environments or machines which don't have working runqemu, so tag all of the tests which use runqemu() so that they can be skipped. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/core/decorators/data: improve has_* logicRoss Burton
has_feature() should be splitting the feature string into substrings and then looking for membership instead of looking for simple substrings. has_machine() should be using equality instead of substrings. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest: remove unused importsRoss Burton
2022-03-31oeqa/core/utils/misc: remove redundant fileRoss Burton
This file dates back to 2016. Half of the functions have never been used, the rest are used in one place and have now been replaced. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31testimage: inline updateTestData()Ross Burton
updateTestData() is just a simple loop that is only used here, so just inline it. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/core/decorator: remove redundant codeRoss Burton
There's no need to wrap *tags in a potential list, as *tags will always be a tuple. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/runtime/decorator/package.py: remove use of strToSetRoss Burton
There's no need to use a series of over-generalised functions to just wrap a string in a tuple. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/buildoptions: set PACKAGE_CLASSES in ↵Ross Burton
test_arch_work_dir_and_export_source test_arch_work_dir_and_export_source uses the archiver to generate SRPMS, so explicitly set PACKAGE_CLASSES to ensure that package_rpm is used. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/wic: add more arch-specific annotationsRoss Burton
Some tests which are marked as x86-specific will actually work on aarch64 (e.g. use EFI), whilst some other tests really are x86-specific (e.g. use syslinux). Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/wic: don't hardcode kernel image type in test_wic_rmRoss Burton
Don't assume bzImage, resepct KERNEL_IMAGETYPE. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/wic: clean up only_for_arch decoratorRoss Burton
There's no need to pass a recipe name when determining the target architecture, there's no need to cap the size of the lru_cache as it will only have one entry, and __name__ is set by @wraps. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/wic: remove redundant assertsRoss Burton
By default bitbake() will raise an assertion if it fails, so there's no need to wrap it in a further assert. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/wic: use os.rename instead of bb.utils.renameRoss Burton
bb.utils.rename() only exists to handle moves across filesystems. As these moves are within the same directory we can just use os.rename(). Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31oeqa/selftest/devtool: ensure Git username is set before upgrade testsRoss Burton
The 'devtool upgrade' tests fail if Git doesn't know the user's name or email, so verify this before the tests start and skip if it is not. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31image_types: hddimg and iso only work on x86Ross Burton
These image types use syslinux which is only available on x86, so only add them to IMAGE_TYPES on x86. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31buildtools-tarball: include nativesdk-python3-pyyamlRoss Burton
BitBake can optionally 'import yaml' if BB_LOGCONFIG specifies a yaml file. This is a 3rd party module, so that this works out of the box when buildtools is used -- either explicitly via buildtools-tarball or implicitly via eSDK -- we can add pyyaml to the buildtools. Signed-off-by: Ross Burton <ross.burton@arm.com>
2022-03-31migration-guides: preliminary description for 3.5Michael Opdenacker
(From yocto-docs rev: 2c24dd801b8d9fa4b81726dcde34a69fde309e4a) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-31manuals: fix quoting of double dashesMichael Opdenacker
Otherwise rendered as "en" dashes by sphinx, for example: git pull –rebase instead of git pull --rebase Readers could confuse them with normal dashes. Exception: replace by \-\- in italic text (*text*) as Sphinx cannot nest italic and quoted text. For consistency, also update quoting in strings in the same code hunks. (From yocto-docs rev: 4e7ce372e37f76148f623a5295a15e08bc2603ff) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-31docs: add poky.yaml and sphinx-static/switchers.js to "make clean"Michael Opdenacker
(From yocto-docs rev: 36d1be3db5f0c9c72aafdb414916ce5abc483f43) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-31overview-manual: add missing upper caseMichael Opdenacker
(From yocto-docs rev: 9de52ac713c89e3e7023148889c234d4ec4c6246) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-31doc: migration-3.5: extend the section on inclusive languageMarta Rybczynska
Add the list of renamed and removed variables, show how the renaming script works. Also mention the change in cve-check output. (From yocto-docs rev: a0b55789035c8d44426b6ff8267b4042ef0a58ba) Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com> Reviewed-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-31ref-manual: Add vfat in list of filesystems supported by kickstartDaniel Ammann
(From yocto-docs rev: 6e09a7eb190c412fa282bde128a6f8f1b24fd713) Signed-off-by: Daniel Ammann <daniel.ammann@bytesatwork.ch> Reviewed-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-31overview-manual: Fix referenceDaniel Ammann
(From yocto-docs rev: 623bcfc66f42c334963bf51c262ef2fc5f9bbd91) Signed-off-by: Daniel Ammann <daniel.ammann@bytesatwork.ch> Reviewed-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-31ref-manual: Remove references to AVAILABLE_LICENSESPeter Kjellerstedt
The AVAILABLE_LICENSES variable has been removed from OE-Core. (From yocto-docs rev: dd687b10e1a21222e8dcc3be29635fd3200a205b) Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com> Reviewed-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-31ref-manual: update Python class documentationRoss Burton
Add new PEP517_* variables, remove obsolete variables, and update for renamed classes. (From yocto-docs rev: 3984d4d0804125ba6fba7bf712edb81f97b4bec7) Signed-off-by: Ross Burton <ross.burton@arm.com> Reviewed-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-31set_versions/switchers: Drop versions shown to the active releasesRichard Purdie
I believe we should only be showing the "active" versions in the switchers base list of releases to show. Zeus and warrior are old and no longer actively maintained and we don't suggest new users use them. gatesgarth is also outside it's support window. I therefore propose removing these leaving us with dev, honister, hardknott, dunfell (LTS). In addition, any release that is selected will be shown, along with any later release in that release series. People can still navigate to the older docs using the releases list or by direct URL but this highlights to users which releases we'd expect/encourage them to be using. (From yocto-docs rev: 5bcd6a632ba2ebace9c65fe8529f8f1de40226ce) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-31releases: update to include 3.4.3Michael Halstead
Build scripts now only require updates in master. (From yocto-docs rev: af6a15e376733727eb26c9c2a6b6a85f6faea437) Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30poky: Drop PREMIRRORS entries for scmsRichard Purdie
The reasons for this are lost in the mists of time. These are already in OE-Core as MIRRORS and we should be falling back to the project as a backup, not a default. Update accordingly. (From meta-yocto rev: 1b71a3b9418fd928fb72bd23898cffe70c43d9d5) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30cve-check: add coverage statistics on recipes with/without CVEsMarta Rybczynska
Until now the CVE checker was giving information about CVEs found for a product (or more products) contained in a recipe. However, there was no easy way to find out which products or recipes have no CVEs. Having no reported CVEs might mean there are simply none, but can also mean a product name (CPE) mismatch. This patch adds CVE_CHECK_COVERAGE option enabling a new type of statistics. Then we use the new JSON format to report the information. The legacy text mode report does not contain it. This option is expected to help with an identification of recipes with mismatched CPEs, issues in the database and more. This work is based on [1], but adding the JSON format makes it easier to implement, without additional result files. [1] https://lists.openembedded.org/g/openembedded-core/message/159873 (From OE-Core rev: d1849a1facd64fa0bcf8336a0ed5fbf71b2e3cb5) Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30cve-check: add json formatMarta Rybczynska
Add an option to output the CVE check in a JSON-based format. This format is easier to parse in software than the original text-based one and allows post-processing by other tools. Output formats are now handed by CVE_CHECK_FORMAT_TEXT and CVE_CHECK_FORMAT_JSON. Both of them are enabled by default. The JSON output format gets generated in a similar way to the text format with the exception of the manifest: appending to JSON arrays requires parsing the file. Because of that we first write JSON fragments and then assemble them in one pass at the end. (From OE-Core rev: df567de36ae5964bee433ebb97e8bf702034994a) Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30zlib: backport the fix for CVE-2018-25032Ross Burton
(From OE-Core rev: 6dd0012846c22478c96655216a8bce44147956f8) Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30python3-urllib3: upgrade 1.26.8 -> 1.26.9wangmy
Changelog: ========== - Changed urllib3[brotli] extra to favor installing Brotli libraries that are still receiving updates like brotli and brotlicffi instead of brotlipy. This change does not impact behavior of urllib3, only which dependencies are installed. - Fixed a socket leaking when HTTPSConnection.connect() raises an exception. - Fixed server_hostname being forwarded from PoolManager to HTTPConnectionPool when requesting an HTTP URL. Should only be forwarded when requesting an HTTPS URL. (From OE-Core rev: 1c44078db4e8fc3ed992ede38708bea0dcf87f11) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30python3-pytz: upgrade 2021.3 -> 2022.1wangmy
(From OE-Core rev: 6099720d01aaab4fd9c878e6026ab4fbb862421c) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30python3-pytest-subtests: upgrade 0.6.0 -> 0.7.0wangmy
Changelog: ========= Fixed support for pytest 7.0, and pytest>=7.0 is now required. (From OE-Core rev: 34f6bc8ca0cfc310fd6ba494b995fa86d28b5a6e) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30python3-pytest-runner: upgrade 5.3.1 -> 6.0.0wangmy
Add dependency python3-distutils. Changelog: ========= - #49: Dropped workaround for older setuptools versions. - Require Python 3.7. - #58: Fixed syntax issue in changelog. (From OE-Core rev: 06162fbbbacbfd705755b5898fb3343483807904) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30python3-jinja2: upgrade 3.0.3 -> 3.1.1wangmy
(From OE-Core rev: 768de8fa99336f6232110cf4158b6bab36ec3c54) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30python3-imagesize: upgrade 1.2.0 -> 1.3.0wangmy
Add dependency python3-xml. (From OE-Core rev: ab1439ec24077461c92d2d150131aee81b2cfe66) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30python3-hypothesis: upgrade 6.39.2 -> 6.39.5wangmy
Changelog: ========= Improve error detection and message when Hypothesis is run on a Python implementation without support for "-0.0", which is required for the "floats()" strategy but can be disabled by unsafe compiler options (issue #3265). If the "shrink" phase is disabled, stop the "generate" phase as soon as an error is found regardless of the value of the "report_multiple_examples" setting, since that's probably what you wanted (issue #3244). (From OE-Core rev: 56702a6c8e066d3730dd336eeb98d10534226601) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30python3-dbusmock: upgrade 0.26.1 -> 0.27.3wangmy
Changelog: ========= packit: Fix file name to sync (From OE-Core rev: 2867273089a46a9d331df4cb11e97066e31a2169) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30python3-asn1crypto: upgrade 1.4.0 -> 1.5.1wangmy
License-Update: year updated to 2022 Changelog: ========= - Handle RSASSA-PSS in keys.PrivateKeyInfo.bit_size and keys.PublicKeyInfo.bit_size - Handle RSASSA-PSS in keys.PrivateKeyInfo.wrap and keys.PublicKeyInfo.wrap - Updated docs for keys.PrivateKeyInfo.algorithm and keys.PublicKeyInfo.algorithm to reflect that they can return "rsassa_pss" (From OE-Core rev: 8fbe3bd4aca7a8906e342bcc9f27e205398919c3) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30bitbake: bitbake: bitbake-user-manual: punctuation fixesMichael Opdenacker
- Replace hyphens by em dashes when necessary See https://www.grammarly.com/blog/hyphens-and-dashes/ - No uppercase after em dashes - No uppercase after colons if what follows is not a complete sentence. - Fix spacing before colons ":" - Replace em-dashes with colons for consistency in a section (Bitbake rev: 72230d6a9976b3bfca1f1e6fb09736fec195e2fe) (Bitbake rev: f1c4ac816e927f490fb9852c12aa408e8c9403b1) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30bitbake: build: Add missing parameter to TaskInvalidRichard Purdie
Fixes: File "bitbake/lib/bb/build.py", line 585, in _exec_task event.fire(TaskInvalid(task, d), d) TypeError: __init__() missing 1 required positional argument: 'metadata' (Bitbake rev: 16ea4429344e36ff022616abd7fa74e5964b6d6a) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30bitbake: cooker: Rework force parser shutdownRichard Purdie
The "force" option to parser shutdown was often the cause of lockups and there is no good reason we should have two different behaviours. Change and unify the codepaths to always: * Wait for longer for a controlled shutdown of a process (0.5s). Usually it will be much faster if it has finished so the delay doesn't really matter. * Send processes a SIGINT * Failing that, send a SIGTERM * Call .close() if available to release zombies This means we no longer need the "force" parameter to the function so it is removed. (Bitbake rev: de88c62ef873e9fce78ba162f5311d846de96f2b) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>