aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2022-07-06config.json: use buildtools on alma8contrib/sakomanSteve Sakoman
Signed-off-by: Steve Sakoman <steve@sakoman.com>
2022-06-21config.json: Backport bringup targets to dunfellRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-15config.json: Simplify sstate structureRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-13config.json: add missing configuration for meta-virt Xen for qemux86-64 testSteve Sakoman
Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-05oe-build-perf-report-email: Drop phantomjs email generation supportRichard Purdie
This approach didn't work reliably so switch to text based emails pointing at the website version with graphs and data. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit c0a7cac39acba54e106fa74143c5de7c5eeefab8) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-05scripts/build-perf-test-wrapper: Update to only send text based emailsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit c77f588773924fd724b3c42daace24d6cce50d52) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-30config.json: Update config for meta-virt to match masterRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-25config.json: Update perf worker target namesRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30config.json: Update to 3.4 buildtools tarballRichard Purdie
Fixes diffoscope-native failing in diffoscope tests on workers using buildtools: File "/home/pokybuild/yocto-worker/reproducible-ubuntu/build/build-st/tmp/work/x86_64-linux/diffoscope-native/190-r0/recipe-sysroot-native/usr/lib/python3.10/ctypes/__init__.py", line 392, in __getitem__ func = self._FuncPtr((name_or_ordinal, self)) AttributeError: nativepython3: undefined symbol: archive_version_number Missing or incomplete libarchive module. Try installing your system's 'libarchive' package. (there is a glibc symbol mismatch hidden in a module compile for libarchive) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit f5e89b7431fcde4c54617eca2fbeae43557811d8) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-03-30config.json: Switch to 3.4 M2 buildtoolsRichard Purdie
This adds lz4c, zstd and pzstd for new tools requirements. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 502bcbbacfd6664d95bafd76fb0e1ee72027e4cb) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-02-22shared-repos: Use tar instead of rsync for speedRichard Purdie
The rysnc of 20,000 files (650MB) onto the nas is slow taking ~3 minutes at idle and worse at load. This is due to the number of files which is a pain point for NFS. This piece of the build is also a bottleneck since the rest of a build depends on it happening. If we switch to zstd compressed tar, it takes 2.49s. Other compression methods were much slower but zstd seems 'accptable' and speeds things up too. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit aff49e938ee34e1fc5a2954e3e22a4ca1ae9ac7b) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-02-22prepare-shared-repos: Make it clear when rsync starts in logsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 8e996a95a8902b40380dd477ecb606cc969cdee9) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-02-22scripts/prepare-shared-repos: Use tmpfs for speedRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 298a10575851d501204fe1ee0d1dcbcec37a66cd) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-01-07config.json: Add other repo defaults to fix check-layer-nightly for meta-awsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-01-07config.json: Fix dependency order aws needs meta-oeRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-20config.json: set max load in PARALLEL_MAKETrevor Gamblin
Add "-l 52" to PARALLEL_MAKE in config.json to limit Make and Ninja builds based on the detected system load. With this option added, if either tool has at least one job running and detects that the system load exceeds the given value, it will wait until either the system load average drops below that limit, or until all other jobs are finished before starting additional jobs. Since most autobuilder machines have 56 cores, this should help keep the system from being overloaded during builds. Reference: https://www.gnu.org/software/make/manual/html_node/Parallel.html Signed-off-by: Trevor Gamblin <trevor.gamblin@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 5c5fc7bcd221427d34bbac80c9bad315fb6de4df) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-27config.json: Ensure BB_HASHSERVE is set in SDKs to autoRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 4689763b513521fc70cca576b88035de240a3ba6) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-27config.json: Add BB_HASHSERVE to SDK_LOCAL_CONF_BLACKLISTRichard Purdie
This should avoid issues with the hashequiv code attempting to contact an non-existent server in the eSDKs built by the project. [YOCTO #14471] Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 4db17f4c9da4efb48d428256efb696d86935a3ea) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-08-04config.json: Update check-layer to use --no-auto-dependency after ↵Richard Purdie
yocto-check-layer changes Add layer checks for meta-aws and meta-openembedded while we're at it Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit fe72e222961d69dcd4d638e7e05b437a65e8f34c) Signed-off-by: Steve Sakoman <steve@sakoman.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-06-24config.json: Switch to newer buildtools-extended-tarballRichard Purdie
This adds locale information which should fix reproducibility issues with vim. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 345475b99a59ef78a8736e3832c85a07ac7923e2) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-06-02config.json: Add check-layer-nightly with only meta-intel at this pointRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-05-20config.json: Set XZ limits to more reasonable values on autobuilderRichard Purdie
The autobuilders have 128GB memory, we don't want them using 50% which is the default, 5% should be enough. Also limit the number of threads down from 48 to something reasonable. This may be partly causing some of our performance issues? Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-25config: build and test SDKs when using package_debRoss Burton
Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit b38664d2db940d2ef3238fdf0f2353162e120681) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25config.json: Split reproduciblity tests into their own targetRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 97e0979d6eb0300951445bb2cc5eda315681302e) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25scripts/run-config: Disable output bufferingRichard Purdie
Line buffering (bufsize=1) is unavailable with binary mode so use unbuffered mode instead. This fixes python runtime warnings. [YOCTO #14093] Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit c21732937c89f7b13a4f8a9a02d7fcb15a4bad2d) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25config.json: Add further descriptionsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 19b7456b92c2eb7b2b27f1e378dbc793d068ee3c) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25config.json: Unbreak qa-extras locked sigs testRichard Purdie
qa-extras and qa-extras2 were split incorrectly, fix this. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 80fe0ab06972c46c82cde29cbdfcdac6e87dde99) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25config.json/run-config: Add support for shortnames and descriptionsRichard Purdie
Learn from the previous experiments and add meaninful shortnames and descriptions to work around the 50 char name limit. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit bceb63fb7952c6ed289733471a0177cfbc365a1e) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25scripts/shared-repo-unpack: Add flush call to update the output more ↵Richard Purdie
regularly before buildtools Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 6e2825564c0b7b69f56e6e589ec15a1cebdb26d1) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25scripts/run-config: Remove redundant boilerplate jsonRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 2bb48042438f3154bbfa6fbc7f2c7556bfa7c762) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25config.json/run-config: Add human readable descriptions of stepsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit ce63e8f024834a670cea660c61be632191aed9b9) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25scripts/run-config: Ensure logging to both logfile and stdoutRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit b1bc4d64c2d0a7e61aea154635996b6b4a4d04c2) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25scripts/run-config: Improve logfile namingRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 4a4c888f6618c3a7273c6dfe30b640e75e2b0de8) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25run-config: Adapt to two pass executionRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 23d65680f8019bccc3fce20381dfcf49f265f601) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25scripts/run-config: If target is present default to 1 stepRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit e183db413f3b67e0d45a2a9a697aa36b6c90601f) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25scripts/run-config: Ensure stepnum has a value when there are no stepsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit afb6c5a88773d4da4a8dfd88f19654ca585efc95) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-03-25scripts/run-config: Don't execute steps that don't exist!Richard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 290e1bc2ee18d5fa88aca84125fb6691db3db5f9) Signed-off-by: Steve Sakoman <steve@sakoman.com>
2021-02-23send-qa-email: Save the QA email in case it doesn't reach the mailing lists.Michael Halstead
Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-13config.json: QAMAIL_CC => qa-build-notificationTim Orling
Replace the hard-coded individual email addresses with the mailing list created for this purpose: qa-build-notification@lists.yoctoproject.org Signed-off-by: Tim Orling <timothy.t.orling@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20scripts: Add target present check scriptRichard Purdie
Add a script which from the exit code determines if a build target is present in the configuration. The autobuilder can use this to determine whether to execute the target at all or whether to skip it. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-24scripts/send-qa-email: Fix buildtools handlingRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-23config.json: Switch to dunfell buildtools with jinja2 addedRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-23utils: Teach buildtools script handling about unsetRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-23scripts/send-qa-email,utils: Use buildtools if presentRichard Purdie
resulttool has python version requirements so use buildtools if present. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-23config.json: Update to buildtools with selftest fixesRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-23config.json: Update to buildtools tarball with jinja2Richard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-07scripts/utils: Ensure buildtools tarball hash matches any supplied valueRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-07scripts/utils: Ensuring new logging is flushed from buffersRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-07scripts/utils: Add more logging for fetchgitrepoRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-01scripts/send-qa-email: Update to dedicated push capable domainMichael Halstead
Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
generated by cgit 1.2.3-korg (git 2.39.0) at 2024-05-01 08:27:07 +0000