summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2022-07-01scriptutils: fix style to be more PEP8 compliantMarius Kriegerowski
(From OE-Core rev: 61b346d6c309ebfef50c88260bf5a0650c74db16) Signed-off-by: Marius Kriegerowski <marius.kriegerowski@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01libcheck: Fix too long shebang for native case.Paulo Neves
It requires a shebang wrapper due to the fact that awk interpreter has an argument. (From OE-Core rev: 3ced538ef2b6d509bec5a619837382de574c710e) Signed-off-by: Paulo Neves <ptsneves@gmail.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01utils: Add cmdline_shebang_wrapper util.Paulo Neves
Useful to work around shebang relocation issues, where shebangs are too long or have arguments in them, thus preventing them from using the /usr/bin/env shebang. (From OE-Core rev: 6edc1fffcbe1405d8c309a75643d7d6cd9a92848) Signed-off-by: Paulo Neves <ptsneves@gmail.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01oeqa/selftest: Test staged .la and .pc filesPaulo Neves
These files are checked by qa_check_staged but there was no test cases for whether the tests actually worked. Now there are. (From OE-Core rev: 2a96719a201cb7b8db774718adec89dbd7e1aec3) Signed-off-by: Paulo Neves <ptsneves@gmail.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01oeqa/selftest: Add test for shebang overflowPaulo Neves
Make sure we do not stage any executable with a bigger shebang than 128. Fixes [1] [1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=11053 (From OE-Core rev: 280f68528c93b5ffab888c99190accf59e807a3f) Signed-off-by: Paulo Neves <ptsneves@gmail.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01insane.bbclass: Make do_qa_staging check shebangsPaulo Neves
As reported in the bug report [1], there was no check for shebang sizes on native scripts and now this is fixed. The path scope of the qa_staging was increased from just checking libdir to all the relevant SYSROOT_DIRS. It is possible to skip this check through INSANE_SKIP. [1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=11053 (From OE-Core rev: 377fe11bc0d6939ab1aaebab1bf4e55adca1ab15) Signed-off-by: Paulo Neves <ptsneves@gmail.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01bitbake: fetch2: gitsm: fix incorrect handling of git submodule relative urlsGennaro Iorio
As specified by git submodule manual relative urls can start either with '..' or './', second case was incorrectly managed leading to an interpretation of urls starting with './' as absoulte urls. (Bitbake rev: 4a0bd3bcd1f7fc25364df8bbf185ff64881c015b) Signed-off-by: Gennaro Iorio <gennaro.iorio@schindler.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01ncurses: use GitHub mirror, not Debian's packagingRoss Burton
The GitHub mirror of ncurses is updated daily, whereas the Debian packaging repository is only updated when they do an upgrade. (From OE-Core rev: 3c53e0dfb2d41ab2c933764ecd5a56c5f43bf8eb) Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01openssl: Upgrade 3.0.3 -> 3.0.4Richard Purdie
Includes a fix for CVE-2022-2068. (From OE-Core rev: f034faebd45e63385849078e6ee4b51257763e99) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01glibc-tests: not clear BBCLASSEXTENDKai Kang
It clears BBCLASSEXTEND in glibc-tests recipe to remove 'nativesdk' which is set in glibc recipe. The side effect is that it removes "${MULTILIBS}" at same time if multilib enabled. Then there will no multilib version glibc-tests. So only remove 'nativesdk' from BBCLASSEXTEND rather than clear it. (From OE-Core rev: d15975441471c9367b6d8cfa094f093e80f910d4) Signed-off-by: Kai Kang <kai.kang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01createrepo-c: upgrade 0.20.0 -> 0.20.1wangmy
(From OE-Core rev: 90793f0e1d67e9f8d84f9c8ad8e576aeec5d12aa) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01sudo: upgrade 1.9.11p2 -> 1.9.11p3wangmy
Changelog: ========== - Fixed "connection reset" errors on AIX when running shell scripts with the intercept or log_subcmds sudoers options enabled. Bug #1034. - Fixed very slow execution of shell scripts when the intercept or log_subcmds sudoers options are set on systems that enable Nagle's algorithm on the loopback device, such as AIX. Bug #1034. (From OE-Core rev: 2eaf00e0470b6b77910a349b74f9a634f6a42fb1) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01sqlite3: upgrade 3.38.5 -> 3.39.0wangmy
(From OE-Core rev: 632bf7426a904322904af87c9083b22d6b3c1566) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01repo: upgrade 2.26 -> 2.27wangmy
(From OE-Core rev: 089fb55d7dddd2b6862b267b527f3fc2783f897c) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01speex: upgrade 1.2.0 -> 1.2.1wangmy
CVE-2020-23903.patch removed since it's included in 1.2.1 License-Update: Add "Organisation (CSIRO)" to Copyright 2005-2008 Changelog: =========== Check for _WIN32 instead of WIN32 in preprocessor checks wav_io: check for EOF when seeking in wav (fixes hang discovered by fuzzing, see #9) CI: add gitlab CI integration fixed-point: make left shift macros use unsigned to avoid undefined behaviour math_approx: use unsigned int for LCG pseudorandom generator (avoids integer overflow) oss-fuzz: add integration and fuzzing target speexenc: guard against invalid channel numbers (see #13) speexdec: make left shift macros use unsigned to avoid undefined behaviour autotools: do not use deprecated macros (From OE-Core rev: 4a0bd109d59bd51c98ce31c9a9e7904a88e01215) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01speexdsp: upgrade 1.2.0 -> 1.2.1wangmy
License-Update: Add "Organisation (CSIRO)" to Copyright 2005-2008 Changelog: ========= CI: add gitlab CI integration fixed-point: Remove unused MULT16_32_Q1[1-4] macros and inlines fixed-point: don't truncate 32-bit arg to MULT16_32_Q15 fixed-point resample: remove 1-bit shift right before interpolation fixed-point: introduce MULT16_32_32 to handle unexpected types in MULT16_32_Q15 Fix incorrect macro names in arch.h Remove unused stack_alloc.h autotools: do not use deprecated macros (From OE-Core rev: 71b9992799981d5211b4f38a53b7bafe8d1b9c38) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01harfbuzz: upgrade 4.3.0 -> 4.4.0wangmy
Changelog: ========== - Caching of variable fonts shaping, in particular when using HarfBuzz’s own font loading functions (ot). Bringing performance of variable shaping in par with non-variable fonts shaping. - Caching of format 2 “Contextual Substitution” and “Chained Contexts Substitution” lookups. Resulting in up to 20% speedup of lookup-heavy fonts like Gulzar or Noto Nastaliq Urdu. - Improved ANSI output from hb-view. - Support for shaping legacy, pre-OpenType, Windows 3.1-era, Arabic fonts that relied on a fixed PUA encoding. - Sinhala script is now shaped by the USE shaper instead of “indic” one. - Thai shaper improvements. - hb-ot-name API supports approximate BCP-47 language matching, for example asking for “en_US” in a font that has only “en” names will return them. - Optimized TrueType glyph shape loading. - Fix subsetting of HarfBuzz faces created via hb_face_create_for_tables(). - Add 32 bit var store support to the subsetter. - New API +HB_BUFFER_FLAG_DEFINED +HB_BUFFER_SERIALIZE_FLAG_DEFINED +hb_font_changed() +hb_font_get_serial() +hb_ft_hb_font_changed() +hb_set_hash() +hb_map_copy() +hb_map_hash() (From OE-Core rev: bfe0f5b8fe449d2f7a4ac9d3629220a4190f70c5) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01git: upgrade 2.36.1 -> 2.37.0wangmy
(From OE-Core rev: bfd4abe83f9eae572559b9ec0f33a252dff566f5) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01dmidecode: upgrade 3.3 -> 3.4wangmy
Changelog: ========== - Support for SMBIOS 3.4.0. This includes new memory device types, new processor upgrades, new slot types and characteristics, decoding of memory module extended speed, new system slot types, new processor characteristics and new format of Processor ID. - Support for SMBIOS 3.5.0. This includes new processor upgrades, BIOS characteristics, new slot characteristics, new on-board device types, new pointing device interface types, and a new record type (type 45 - Firmware Inventory Information). - Decode HPE OEM records 194, 199, 203, 236, 237, 238 ans 240. - Bug fixes: Fix OEM vendor name matching Fix ASCII filtering of strings Fix crash with option -u - Minor improvements: Skip details of uninstalled memory modules Don't display the raw CPU ID in quiet mode Improve the formatting of the manual pages (From OE-Core rev: 5928085c909365d7569f26243058a328ef2832e1) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01busybox: fix CVE-2022-30065Ross Burton
(From OE-Core rev: bf3d981b0303eab91d4cb19092ac27b489c8ad27) Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01recipetool/devtool: Fix python egg whitespace issues in PACKAGECONFIGThomas Roos
Substitute expressions or whitespace from python egg requires.txt when generating PACKAGECONFIG Pysetuptools sees the uvicorn.egg-info/requires.txt as extra requirements. Recipetool parses this information to generate the PACKAGECONFIG. These extra requirements contain expressions and whitespace, which are not allowed in PACKGAGECONFIG. This patch substitute them by hyphens to make PACKAGECONFIG parsable and readable. Also adding an oe-selftest for this. [YOCTO #14446] (From OE-Core rev: a854d95a79e64f3f82abfa4cc1daec750abf4249) Signed-off-by: Thomas Roos <throos@amazon.de> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30buildperf/base.py: skip reduced_proc_pressure directoryAryaman Gupta
Buildperf was designed to skip all non-directories under buildstats, i.e. proc log files. With the /proc/pressure stats being collected in a new directory, the following error was seen: meta/lib/oeqa/buildperf/base.py", line 392, in split_nevr n_e_v, revision = nevr.rsplit('-', 1) ValueError: not enough values to unpack (expected 2, got 1) Add an additional check to skip the reduced_proc_pressure directory. (From OE-Core rev: d3a25dd7aa63ab98c8bb931b4b3bc61807806ed3) Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30dev-manual: improve screenshot resolutionMichael Opdenacker
Screenshot from executing an NPM package built by npm.bbclass (From yocto-docs rev: 57acf2f65e5e5798f369a24c4a0cc9b5cdb8e1db) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30dev-manual: update section about creating NPM packagesMichael Opdenacker
From running the instructions using Poky master In particular, update command output and the contents of generated files. The "cute-files" example application can now directly be run, without having to run it through "node". (From yocto-docs rev: a100fb1e25e3f2e144d771d31e952deae2fe3302) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30docs: add CONVERSION_CMD definitionAatir Manzur
(From yocto-docs rev: 05d376ccc65510a7d636e2685fb92a48d4712b0b) Signed-off-by: Aatir Manzur <aatrapps@gmail.com> Reviewed-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30cve-extra-exclusions: Clean up and ignore three CVEs (2xqemu and nasm)Richard Purdie
Remove obsolete comments/data from the file. Add in three CVEs to ignore. Two are qemu CVEs which upstream aren't particularly intersted in and aren't serious issues. Also ignore the nasm CVE found from fuzzing as this isn't a issue we'd expose from OE. (From OE-Core rev: 68291026aab2fa6ee1260ca95198dd1d568521e5) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30buildstats.py: close /proc/pressure/cpu file descriptorAryaman Gupta
Use python 'with' symantics to ensure that the /proc/pressure/cpu file descriptor used in SystemStats init is closed. Previously, this would lead to a single file descriptor being leaked. For example: ResourceWarning: unclosed file <_io.BufferedReader name='/proc/pressure/cpu'> (From OE-Core rev: 643653160cd77d346cdc9b9ec25c7212c7dfe176) Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30oe-selftest-image: Ensure the image has sftp as well as dropbearRichard Purdie
We need sftp so that scp works with recent openssh. Use the packagegroup instead of a direct dependency to ensure this. (From OE-Core rev: 2b76c8e5fc8802bbe54371119e6bf6312bf2a8ec) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30cve-check: hook cleanup to the BuildCompleted event, not CookerExitRoss Burton
The cve-check class writes temporary files to preserve state across the build, and cleans them up in a CookerExit handler. However, in memory-resident builds the cooker won't exit in between builds, so the state isn't cleared and the CVE report generation fails: NOTE: Generating JSON CVE summary ERROR: Error adding the same package twice Easily solved by hooking to BuildCompleted, instead of CookerExit. (From OE-Core rev: fccdcfd301de281a427bfee48d8ff47fa07b7259) Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30cups: ignore CVE-2022-26691Ross Burton
This is fixed in 2.4.2, which we have, but the complex CPE in that CVE isn't parsed by cve-check correctly so it thinks that we're vulnerable. (From OE-Core rev: b40dd920f8b40eabe78db363249257818c63c074) Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30ncurses: 6.3 -> 6.3+20220423Richard Purdie
Includes a fix for CVE-2022-29458 (From OE-Core rev: 6032a1049d4693f17ab7f4b67f9b22719decadde) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30vim: 8.2.5083 -> 9.0.0005Richard Purdie
The license checksum changed due to a major version change in the referenced file. (From OE-Core rev: 89f34d8aa4f4572d048dbb732ca4c83d443157fb) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29rust: fix issue building cross-canadian tools for aarch64 on x86_64Peter Bergin
Commit bd36593ba3db758b3eacc974e48468a665967961 did introduce a regression when building package rust-cross-canadian-aarch64 on a x86_64 host. This commit will fix that configuration. Suggested-by: Richard Purdie <richard.purdie@linuxfoundation.org> (From OE-Core rev: ef566af964e9f9d2c440a3b5771ed801216f30f9) Signed-off-by: Peter Bergin <peter@berginkonsult.se> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29binutils : CVE-2019-1010204Pgowda
Upstream-Status: Backport [https://sourceware.org/git/gitweb.cgi?p=binutils-gdb.git;h=2a4fc266dbf77ed7ab83da16468e9ba627b8bc2d] (From OE-Core rev: 0c55355a83130c2c0a59e9fb94f8914499943dd4) Signed-off-by: Pgowda <pgowda.cve@gmail.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29python3-pycryptodome: upgrade 3.14.1 -> 3.15.0wangmy
Changelog: ========= New features ------------ Add support for curves Ed25519 and Ed448, including export and import of keys. Add support for EdDSA signatures. Add support for Asymmetric Key Packages (RFC5958) to import private keys. Resolved issues --------------- GH#620: for Crypto.Util.number.getPrime , do not sequentially scan numbers searching for a prime. (From OE-Core rev: 5ed8d56bfcc5b38746d27585e064ff2a0489c1c0) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29python3-numpy: upgrade 1.22.4 -> 1.23.0wangmy
Changelog: ========== The NumPy 1.23.0 release continues the ongoing work to improve the handling and promotion of dtypes, increase the execution speed, clarify the documentation, and expire old deprecations. The highlights are: Implementation of loadtxt in C, greatly improving its performance. Exposing DLPack at the Python level for easy data exchange. Changes to the promotion and comparisons of structured dtypes. Improvements to f2py. (From OE-Core rev: 8ac4f77e10b5c73b05c06a712b4c4eccd7681762) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29python3-dbusmock: upgrade 0.28.0 -> 0.28.1wangmy
Changelog: ========== Again works on RHEL/CentOS 8 (0.27 broke there), now in CI Avoid glib GI dependency for main dbusmock, for running in virtualenv (From OE-Core rev: f56350997a8e4678d14abe798d6eb2356b061147) (From OE-Core rev: e14def00341b3f2f03e9fc8857aa804daaf329e9) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29python3-certifi: upgrade 2022.5.18.1 -> 2022.6.15wangmy
(From OE-Core rev: 0a1b314e4cfa8b9ab25ba5b54a12a4862090f214) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29python3-babel: upgrade 2.10.1 -> 2.10.3wangmy
Changelog ========= Fallback count=”other” format in format_currency() (#872) Fix get_period_id() with dayPeriodRule across 0:00 (#871) Add support for b and B period symbols in time format (#869) chore(docs/typo): Fixes a minor typo in a function comment (#864) (From OE-Core rev: 57fe354881a31b8a60d32db4aa561e22fc7bf0a5) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29python3-importlib-metadata: upgrade 4.11.4 -> 4.12.0wangmy
License-Update: Add text content of “http://www.apache.org/licenses/LICENSE-2.0" to LICENSE Changelog: =========== py-93259: Now raise ValueError when None or an empty string are passed to Distribution.from_name (and other callers). (From OE-Core rev: 3c7237a7348bc85dbc8086aa6fb079af1fa97979) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29python3-chardet: upgrade 4.0.0 -> 5.0.0wangmy
This release is the first release of chardet that no longer supports Python < 3.6. License-Update: Adjust document format, change "St" to "Street" (From OE-Core rev: d8bc9503058b067d4157b9177c16d06136918071) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29buildstats.bbclass: correct sampling of system statsAryaman Gupta
The last time of sampling would be updated within the SystemStats class but not re-recorded into the datastore, leading to multiple samples being collected in the same second in the sample function of buildstats.py. Fix this to collect and store only one sample per second within a certain tolerance to deal with variation in the arrival time. This fix elimates the spikiness of sampled data, in cases where the difference between the current and the last sample is taken. Previously, since many samples per second were recorded, certain types of data would result in a very small elapsed time and hence a small numerical difference. For example, the CPU usage from /proc/stat is a running total of usage and taking the difference between data collected 0.1 seconds apart would result in usage appearing lower than it actually was. (From OE-Core rev: 0e2df45ab066bb4ad2c4f8622ee9c1a8ecdea9cb) Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com> Signed-off-by: Randy MacLeod <randy.macleod@windriver.com> Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29pybootchartgui: render cpu and io pressureAryaman Gupta
Add two new, separate charts showing the avg10 and delta total pressure over time for the CPU and IO resources. The height of the avg10 data in each chart represents the percentage of time "some" task was delayed over the specific resource during the last 10 seconds of the build. The height of the delta total data in each chart represents the total time "some" task was delayed since the last sample was collected. If the reduced_proc_pressure data is not present in the buildstats log, then the new charts are not shown at all rather than being present but unpopulated. Note that the delta total graphs may appear "spikey", oscillating from high values to low. This behaviour is fixed in a subsequent commit. (From OE-Core rev: fb9ff46dc3059cb3f4c8df8e4654184c3eab1571) Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com> Signed-off-by: Randy MacLeod <randy.macleod@windriver.com> Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29buildstats.py: enable collection of /proc/pressure dataAryaman Gupta
The Linux pressure monitoring system helps determine when system resources are being overutilized by measuring how contended the CPU, IO and memory are. This information can be found under /proc/pressure/ which contains 3 files - cpu, memory and io. In each of the files, the format is as follows: some avg10=70.24 avg60=68.52 avg300=69.91 total=3559632828 full avg10=57.59 avg60=58.06 avg300=60.38 total=3300487258 The "some" state of a given resource represents when one or more tasks are delayed on that resource whereas the "full" state represents when all the tasks are delayed. Currently, we only collect data from the "some" state but the "full" data can simply be appended to the log files if neccessary. The "avg10", "avg60" and "avg300" fields represent the average percentage of time runnable tasks were delayed in the last 10, 60 or 300 seconds respectively. The "total" field represents the total time, in microseconds, that some runnable task was delayed on a resource. More information can be found at: https://www.kernel.org/doc/html/latest/accounting/psi.html and in the source code under kernel/sched/psi.c This commit adds functionality to collect and log the "some" CPU, memory and IO pressure. The "avg10", "avg60" and "avg300" fields are logged without change. In place of the "total" field, the difference between the current "total" and the previous sample's "total" is logged, allowing the measurement of pressure in between each polling interval, as was done for /proc/stat data. The log files are stored in: <build_name>/tmp/buildstats/<build_time>/reduced_proc_pressure/{cpu,io,memory}.log mirroring the directory structure of /proc/pressure. If the /proc/pressure directory does not exist or the resource files can't be read/opened, the reduced_proc_pressure directory is not created. (From OE-Core rev: 061931520b8baa7f3a03bf466aa9ec8bf995bc14) Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com> Signed-off-by: Randy MacLeod <randy.macleod@windriver.com> Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29strace: Drop redundant oe_runmake parameterniko.mauno@vaisala.com
PARALLEL_MAKE is now honored in ptest.bbclass, so drop redundant parameter from oe_runmake call. (From OE-Core rev: c314316831ac602a31275c303c36974e8a632ce5) Signed-off-by: Niko Mauno <niko.mauno@vaisala.com> Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-28bitbake.conf: Change -dev RDEPENDS to RRECOMMENDSRichard Purdie
Switch the default DEPENDS for ${PN}-dev to be a RRECOMMENDS instead. This takes advantage of a change to complmentary package globbing to not follow RRECOMMENDS and means and SDK for an image with both openssh and dropbear compoments will now build successfully. (From OE-Core rev: 6f28420ab0e8f2ab5eb06326024777a40aded0a6) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-28bitbake.conf/recipes: Introduce add DEV_PKG_DEPENDENCY to change ↵Richard Purdie
RDEPENDS:${PN}-dev There is a pattern that several recipes need to break the dependency of ${PN}-dev on ${PN}, most often as ${PN} may be be empty. Add a new variable to parameterise this and allow it to be changed more easily. (From OE-Core rev: a5b381c0f45c590a762647a9956a8f41e2e2315e) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-28package_manager: Change complementary package handling to not include soft ↵Ross Burton
dependencies We've some long standing bugs where the RDEPENDS from -dev packages causes problems, e.g. dropbear and openssh components on an image working fine together but then the SDK failing to build as the main openssh and dropbear packages conflict with each other (pulled in by openssh-dev and dropbear-dev). We propose changing the behavour of complementary package installation to ignore RRECOMMENDS. If we then change the ${PN}-dev dependency on ${PN} to a RRECOMMENDS, we can avoid many of the issues people run into yet still have the desired behaviour of ${PN}-dev pulling in ${PN}. This therefore changes the package manager code so that it doesn't follow RRECOMMENDS for completementary package globs. [RP: Added deb support] (From OE-Core rev: b44b0b9294675f89aa51ff84f532664f4c479677) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-28packagegroup-core-ssh-dropbear: Add openssh-sftp-server recommendationRichard Purdie
Seems sad to have to do this but openssh is moving to use sftp instead of scp to move files. This means scp from Fedora 36 will no longer be able to move files to/from a dropbear based image. This breaks a number of our key QA tests and I suspect will cause users pain too. The sftp server from openssh is small (200kb uncompressed) and standalone so adding it to the packagegroup seems to be the best way to preserve user sanity. If people really don't want it, they can just use dropbear instead of the packageground. (From OE-Core rev: a98188e83b2c027d99cc38e3367e1ec2a98efbb0) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-28pango: exclude 1.9x versions which are 2.x pre-releases.Alexander Kanavin
(From OE-Core rev: 5f03fe6d3655649fd43774afe65bc2590a416c58) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>