| Age | Commit message (Collapse) | Author |
|---|
|
The basic idea is to run two world builds in different hosts
to compare the output artifacts and get the information about
reproducible builds.
The sstates are disabled in the world build to get real information
becuase if a sstate is used it will be equal in binary comparisions
so a full build is needed.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
|
|
As the identifier is mandatory we should always check for the tag
in the entry body to be certain we've found the correct entry in
the log. This prevents two controllers writing extra info to the
same wikilog entry when they both happen to be building the same
commit of the same branch.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The SSTATE_MIRRORS variable was being assigned a value without
whitespace between the \n and the file protocol declaration.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
Set SANITY_TESTED_DISTROS = "" so that we don't cause a cacophony of
errors when the worker host OS isn't in that list. This is likely to
happen when testing new distros or when the workers haven't yet been
upgraded as a distro falls out of official testing.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
We need to use an append (+=) operating to add to SSTATE_MIRRORS
as the populate_sdk_ext class already sets an SSTATE_MIRRORS
variable to pick up uninative tarballs.
Furthermore fix the inclusion of a new line in the variable
assignment by correctly escaping special sequences in the string.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
We're not using this buildstep, and its output wasn't very helpful,
so remove it.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
We don't run it on the production controllers as its output isn't
very helpful and it oft fails. To be replaced in future if the
need arises.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
This reverts commit 3ee90eccd2a6e026afca5a3478665409938d0069 as
the output of nightly-distrodata is less useful than expected.
|
|
The twistd.log is very chatty, prefix wikilog log messages with "wkl:"
in order to make them easier to find and therefore wikilog easier to
debug.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
Instead of blindly updating all occurences of the template words across the
entire fetched content we need to try and locate the buildlog entry related
to the build being reported on. This improves reliability when multiple
controllers are writing to the same wikilog.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
If we have more than one controller logging to the same wiki page, or more
than one triggered build running at once, the naive assumption that the
topmost/most recent log entry is the one to update is invalid.
Do a bit more work to try and find an entry with a title that matches
what we know about the build being logged.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
We need to be able to better identify wikilog entries from different
controllers so that we can update the wikilog accurately when multiple
controllers are running builds and triggering writes to the log at the
same time.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
This reverts commit ff16dedca57e7d5b76c9c079b90fbdcce10b2d74.
OE-Core isn't ready for this change yet, we see several failures
when running with the BuildImages step removed.
|
|
buildbot.interfaces.IProperties.getProperty() takes a default value as a
second parameter. Use this to clean up property usage so that we don't
always have to check the property is set before accessing its value.
Furthermore when the property is an int-as-string, which we'll only ever
use as a string, create an int object from the string once and store it
at the time of reading the property rather than creating the int object
every time we wish to compare the value.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
An unused string variable, tag, had crept in with an earlier change,
delete it.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The edit item in the JSON dict is a dictionary, not a list, so fix
the default value we pass to get().
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
Rather than trying to print error messages to stdout use the
twisted log.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
Improvements to handling of non-ascii characters in the wiki
content. This prevents exceptions in the wikilog plugin when the
target log page includes non-ascii characters such as emdash '—'.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
We carry a copy of requests now so there's no need to handle it
not being present.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
0.8.2 had several issues with proxies which make it very awkward
to develop and deploy on a network with explicit proxy support.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
hostname on a server install of openSUSE 42.2 is provided by the net-tools
package (rather than the hostname package).
hostname from net-tools doesn't support the -I option and instead uses the
-i option to read the IP addresses of the host.
If the `hostname -I` call fails try `hostname -i` instead.
[YOCTO #11056]
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The tests should be self-sufficient enough to build any required recipes
before attempting to run tests which depend on them.
[YOCTO #10937]
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The BuildImages buildstep will translate the list of native
dependencies to wic-tools as needed, and vice-versa.
Update the buildset-config anyway as wic-tools is shorter and a
little clearer.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The Pyro release of the Yocto Project introduces
recipe-specific-sysroots which change how we can build and use
native tools.
A new recipe, wic-tools, has been added to OE-Core to handle
building the native binaries needed by wic. However we also need
to be able to support the old style list of -native dependencies
when building prior releases.
Handle this by translating between wic-tools and the full list of
native dependencies depending on the OE-Core layer version.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The wiki module makes use of the time module in retry_request() but time
wasn't imported - fix that.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
Remove an unused variable and logging of its default assignment.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
buildbot.interfaces.IProperties.getProperty() takes a default value as a
second parameter. Use this to clean up property usage so that we don't
always have to check the property is set before accessing its value.
Furthermore when the property is an int-as-string which we'll only ever
use as a string create an int object from the string once and store it,
rather than creating the int object every time we wish to compare the
value.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
With fixes in OE-Core for running selftests against minimal eSDK
installers (by installing any packages required by the tests into
the eSDK) we can now build minimal eSDK installers for pyro or
newer.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
We changed nightly.conf so that custom_publish_artefacts defaults
to False, we must also update the buildstep to do the same.
Otherwise when a single builder is started, rather than triggered
by the nightly builder, it will default to publishing artefacts.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
remote_kick has a fixed set of parameters such as the builder (nightly)
and assumes it's run on the controller (hard-codes localhost as the
buildbot URL).
The new forcebuild script is more flexible allowing you to specify buildbot
server url, user, password, builder and options (web inputs).
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The script supports to list avaialable builders and his options,
also can force a build if the builder is IDLE or not.
Also supports specify options via cmdline using python dictionaries
as string.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
|
|
These are now housed in their own repository:
http://git.yoctoproject.org/cgit/cgit.cgi/release-tools/
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
Missing comma after the meta-qt3 repo entry causes parse failures,
add in the comma.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
nightly-qa-extras uses this repo, therefore we need to define it
at the nightly level for when nightly triggers nightly-qa-extras
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
Modify the pattern to ensure md5sum are copied as well as the
toolchain installers.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
We were trying to ensure we only called the updateBuildInfo() method
for steps that were likely to provide additional information for use
in the build log. However on the public autobuilder we observed a
few instances where the buildlog wasn't updated, therefore at the
risk of a little extra and needless work just call updateBuildInfo()
each time a step finishes (no POSTs will be made to the wiki unless
the content of the log entry has been updated).
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The repos definition was incorrect and overwrote the poky defition
with the meta-mingw defintion (due to missing a closing brace),
add in the required braces to fix the definitions.
In a copy/paste error we were building a mingw toolchain for
core-image-minimal and core-image-sato, however as we are only building
this toolchain to provide some buildtesting for meta-mingw we need only
build for a single image (core-image-minimal).
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
nightly-qa-extras: fix repos definition
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
We need to run this regularly on the public autobuilder to ensure issues
aren't introduced which would prevent a release providing useful data.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The Autobuilder needs Python requests for the wikilog plugin, bundle
it as is the norm with the yocto-autobuilder. This ensures consistent
behaviour and easy reproducibility.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The new nightly-oe-build-perf-test buildset executes the
build-perf-test-wrapper.sh into a worker and publish the results to
specified folder by AB config.
When the performance script finish it sends an notifcation email to
yocto alias users, the worker machine needs to configure the email
addresses for yocto alias.
[YOCTO #9377]
Signed-off-by: Monserrat Sedeno <monserratx.sedeno.bustos.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
|
|
Sometimes is a good idea to could specify a machine to build via a build
property/web interface input.
Without this patch if you specify the machine via a build property/web
interface input, the machine is overwrite taking only into account the
default machine set in the buildset.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
|
|
devtool and recipetool selftests both contain assertNotIn() calls which cause
oe-selftest to fail if there's a WARNING in the commands output.
This results in a failure when running builds on the debian-testing worker on
the autobuilder cluster because the non-versioned/rolling release Debian
testing distro isn't listed in SANITY_TESTED_DISTROS and therefore emits a
warning from sanity.bbclass:
WARNING: Host distribution "debian" has not been validated with this version
of the build system; you may possibly experience unexpected failures. It is
recommended that you use a tested distribution.
Work around this issue by setting an empty SANITY_TESTED_DISTROS for the
nightly-oe-selftest buildset.
[YOCTO #10933]
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The wikilog status plugin now takes an optional identifier to help
distinguish between multiple controllers logging to the same wiki
page -- update the example config to demonstrate its use.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
If the DISTRO_VERSION has a value that can't be coerced into a float,
i.e. 2.0.0, GetDistroVersion raises an Exception which is difficult
for a user to understand.
Better handle this scenario by:
1) split the DISTRO_VERSION string and fail the build with an updated
buildstep description if DISTRO_VERSION contains more than one .
2) wrapping the float casting in a try/except and failing with an
update buildstep description should a ValueError be thrown.
[YOCTO #10412]
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
The tgrid is a primary way yocto-autobuilder users monitor builds
and their results. In order to increase linkage between systems
and streamline workflows include a link to the Yocto Project wiki
build log section for the build.
Note: this is a Yocto Project specific customisation of core
Buildbot.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
* Remove an unused variable
* Don't assign a value to deploy then immediately assign a different value
* clean up logic for testing whether to deploy artefacts
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
Add an optional identifier and use it in the log body and posting summary to
enable wikilog reports from different controllers to the same wiki page to
be more easily distinguished.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
|
bdb1fa661dc054f7effd4bbb65773cdc1088f0f0 adopted the skipStep() method
of the BitbakeShellCommand parent class as a unified method to skip part of
a buildstep, but a few instances were missed. Finish the adoption now.
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
|
Aníbal Limón
Joshua Lock
Monserrat Sedeno