aboutsummaryrefslogtreecommitdiffstats
path: root/builders.py
AgeCommit message (Collapse)Author
2019-02-21builders: Add -R option to send-qa-report to pass test results to the scriptRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-08builders: Write test results into testresults subdirRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-12-04builders: At the end of triggers builds, cleanup the shared repo directoryRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-22builders.py: Filter the list of properties we're passing to triggered buildsRichard Purdie
This reduces unnecessary properties being set in builds where we don't need them by filtering to the list of repos the build really needs. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-22builders.py: Don't hardcode the url to the autobuilder-helperRichard Purdie
Use the standard list of repos we already have instead. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-22config/schedulers: Use 'a-' prefix to quick/full to improve sorting in UIRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-21builders/config: Fix configuration problemsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-21config/builders/schedulers: Split nightly into quick and full targetsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-20builders: Improve non-release directory structureRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-20builders: Add option to always collect up test results from buildsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-20builders.py: Simplify publish directory logic to be more reusableRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-07builders: Inherit build properties from nightly schedulerAaron Chan
This change enables the children jobs to inherit the build property from nightly scheduler. Build property inherits yocto release, milestone and rc number from parent job. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-10builders: Increase maxsteps to 9 to match current helper configuration maximumsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-05Revert "builders.py: Fix invalid option"Richard Purdie
This reverts commit 85cd275481acbb58606f79399a7affe8a31f4306.
2018-09-05builders: Improve log handling to match run-config step numberingRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-05builders/yocto_console_view: Add yp_build_branch propertyRichard Purdie
This corresponds to the poky branch being used by default so its easier for users to tell the builds apart and know which ones they are. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-05builders.py: Fix invalid optionRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30builders.py: Fix invalid optionRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30builders: Adapt to autobuilder-helper argparse changesRichard Purdie
In particular this lets us drop the horrible 'None' sentinals. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30Add custom log observerRichard Purdie
We want seperate log files in the UI for each of the build steps. This changes buildbot to monitor the command.log.X files which run-config generates. It also searches the log output for errors and warnings and summarises these neatly in the UI. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-24builders: Add an example of adding extra configuration to workersRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-10builders: Connect in send_email form control to scriptRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-10schedulers/builders: Clean up deploy_artefacts/send_email/is_release into ↵Richard Purdie
true boolean types Lets use the proper BooleanParameter input type and boolean values for these. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-10builders: Drop got_revision hack and replace with yp_build_revision propertyRichard Purdie
The got_revision trick, whilst quite neat, doesn't quite work and is a bit of a hack breaking other buildbot internals. It gets et late in the builds leaving a confusing build display in the meantime. Use a dedicated property to store the "Yocto" build revision instead. This property will be used by our own custom console UI. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-16builders: Pass sharedrepolocation to QA emails scriptRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-15builders: Fix basename version of get_publish_destRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-14builders: Add deploy_artefacts selection/propertyRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-14builders: Add code to trigger QA email sscript in helperRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-09builders.py: Attempt to set revision earlierRichard Purdie
This means the display will show the correct revision before triggering and waiting for all the builds to complete making the display less confusing. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-09builders: Drop bitbake-selftest as moved into the helperRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-03-21builders.py: Ensure we use get_publish_dest, not config.publish_destRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-03-21/builders.pyGraydon, Tracy
Add the releases subdirectory to the release publishing destination path. Signed-off-by: Graydon, Tracy <tracy.graydon@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-03-20builders.py: Don't use Interpolate inside functionsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-03-20builders: Fix syntax/typo in get_publish_dest()Richard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-03-12Wait for all triggers to complete before publishingRichard Purdie
This means that when we stop builds, all triggered builds also stop. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-03-08builders.py: Tweak ordering of setproperty build revisionRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-03-07builders: set build revision to poky revisionPaul Eggleton
By default, since the yocto-autobuilder-helper repository is the only one that buildbot actually checks out in a step, the revision of that is the one that gets associated with the build; however, it's much more useful to have the revision set to the poky revision, so add a step that does that. Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-03-07builders: set early steps to halt on failurePaul Eggleton
If you can't clobber the build directory, check out the helper source or unpack the repos successfully there's really not much point in continuing, so stop the build immediately if they fail. Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-03-07builders: fix get_publish_dest()Joshua Lock
Various errors resulted from not having been able to test the initial implmentation of get_publish_dest(): * incorrect logic to determine whether a build was a release * passing a filename rather than a string representing file contents to json.loads() * missing parameter on a call to buildbot's IProperties.setProperty() Further we update the properties passed to the triggered builds via the Trigger build steps to include the deploy_artefacts and publish_destination properties. This patch is able to succesfully supply required information for the helper scripts to publish artefacts. Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-03-07builders: fix use of util.renderer decorated functionsJoshua Lock
These shouldn't be called at the time of buildstep creation, instead we pass the method name and buildbot calls the function when the step starts. http://docs.buildbot.net/current/manual/cfg-properties.html#renderer Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-03-07builders: implement get_publish_dest()Joshua Lock
Based on the SetDest step in the old codebase this function is used to determine where the artefacts of a build should be published. In order to avoid overwriting previously published content the function keeps a list of destinations which have already been created and written to on the controller and avoids reusing them. Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-03-07builders: implement get_sstate_release_number()Joshua Lock
Uses the values submitted to the scheduler to determtine the major number of the release for the purposes of publishing per-major release shared-state artefacts. Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-03-01builders: fix clobber step for nightly builderJoshua Lock
Copy/paste error resulted in incorrect factory variable name. Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-02-28builders: use yocto-autobuilder-helper's clobberdir scriptJoshua Lock
Removing the build directory (with rm -fr) can take a significant amount of time, longer than the standard buildbot timeout, which delays the builds. Instead, we use the clobberdir script from the helper repository. This script moves the directory contents out of the way to a location which is reaped by a background process. Unfortunately this assumes/requires a copy of the repository is kept in the home directory of the user running buildbot. Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-02-28builders: pass all repo configuration properties to triggered buildersJoshua Lock
Ensure triggered builds have all of the branch_, commit_ and repo_ properties set. Most builders won't use them, but it's simpler to set them all for all triggered builds than to special case specific builders. Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-02-28builders: increase timeout for run-config invocationsJoshua Lock
run-config can run without producing output for longer than the default 1200s/20m timeout value. Increase the timeout to a generous 16200s/4.5h in order to give the script plenty of time to run. Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-02-22Fix module name after renameJoshua Lock
The repository was renamed yoctoabb from yoctoab, fix up module references
2018-02-22Initial prototype of using yocto-autobuilder-helper scriptsJoshua Lock
Initial prototype of using yocto-autobuilder-helper scripts from vanilla buildbot to replicate yocto-autobuilder configuration. * README.md is updated to describe goals and approach * TODO contains known issues and work items, TODO: comments in the code point to specific locations of work Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>