summaryrefslogtreecommitdiffstats
path: root/bitbake
AgeCommit message (Collapse)Author
2014-11-06bitbake: prserv: Use WAL modeRichard Purdie
Ideally, we want the PR service to have minimal influence from queued disk IO. sqlite tends to be paranoid about data loss and locks/fsync calls. There is a "WAL mode" which changes the journalling mechanism and would appear much better suited to our use case. This patch therefore switches the database to use WAL mode. With this change, write overhead appears significantly reduced. (Bitbake rev: 0cdd48261daeb17efc528b5de0ac81c8836e8565) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-11-06bitbake: bitbake: Make printed 'runqueue' be consistently capitalizedGary Thomas
This has always bothered me: NOTE: Preparing runqueue NOTE: Executing RunQueue Tasks This patch changes the messages to be consistent. (Bitbake rev: 72ac9f9227fbfb4dc8b933b357d21aa0e4060959) Signed-off-by: Gary Thomas <gary@mlbassoc.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-11-06bitbake: bs4: Add beautifulsoup 4.3.2 to assist the fetcherAníbal Limón
Added Beautifulsoup module because fetch/wget latest_versionstring method depends on it. This provides support to fetch/wget.py module for search new package versions in upstream sites. (Bitbake rev: 4626c9b77e5eded97507b6f9ca0d891f9a54bb8a) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-11-06bitbake: fetch2/git: Allow other namespaces than refs/heads to be searched.Fredrik Svensson
This makes it possble to fetch Gerrit review references which are normally stored under refs/changes. Please disregard previous patch with the same topic. (Bitbake rev: 268e9c0c6830e8e621c418f20c2ca12dc840e48b) Signed-off-by: Fredrik Svensson <fredrik.svensson@axis.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-11-04bitbake: prserv/serv: Ensure sync happens in the correct threadRichard Purdie
The sync/commit calls are happening in the submission thread which can race against the handler. The handler may start new transactions which then causes the submission thread to error with "cannot start a transaction within a transaction". The fix is to move the calls to the correct thread. (Bitbake rev: 92e128a0e331e563cfe48827e95939041c16c88e) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: bitbake: clarify startup messageAlexandru DAMIAN
Fix the startup message by making clear which server runs on which port. (Bitbake rev: 26d601ab2a677a422bab425696a2cf6357ff3576) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toaster: update web vcs fields for layersAlexandru DAMIAN
We update the layer vcs web fields to record extra URLs for directory and file viewing. Updating the layers view to show this data. (Bitbake rev: 14762e182c8af22fd0fa96f0ba0db1ecd2495fbc) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: provide download file capabilityAlexandru DAMIAN
We add, for the localhost environments, the capability to download build artifacts. This is a pontentially dangerous API, because it gives unrestricted read access to the build environment file system - do not expose the functionality directly to the web layer, but use filtering/translation code, such as exemplified in the build_artifact view. The capability for remote build environments is dependent on bug 6835, as to use the collect storage as intermediary storage for serving files. [YOCTO #6834] (Bitbake rev: 5fce7f6e83c6143244faa9618b7ed20c1106e08f) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toaster: change startup parameter passing to avoid raceAlexandru DAMIAN
We avoid a race between the setting the TOASTER_BRBE variable and reading the variable in toaster ui by supplying the variable at server startup time through the toaster.conf post-read file. Additional small changes are included, including marking the build request with the environment id of where the build took place. (Bitbake rev: 7c333350418c4140e6c988c5272940f8057d327d) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toaster: improvements for admin pagesAlexandru DAMIAN
The default django URL validator marks git URLs as not valid, so we change the default validators to a URLValidator-derived that adds git and ssh protocol schemas and inhibits the frontend URL validator. We update the branch names based on the white-listed branch names in the Releases name. Adds proper class string to ease usage in admin section. Other small improvements. (Bitbake rev: 7d51f895bd56bd18f2258059b377851c2ce82114) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Conflicts: bitbake/lib/toaster/orm/admin.py Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toaster: use modified validators for git url fieldsAlexandru DAMIAN
The default django URL validator marks git URLs as not valid, so we change the default validators to a URLValidator-derived that adds git and ssh protocol schemas and inhibits the frontend URL validator. (Bitbake rev: 7223619505c0939358287e5baf84da0a91cb8d34) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toaster: changes to the landing pageAlexandru DAMIAN
This patch brings in a new landing page to be shown when there are no builds and no projects available. The builds page now displays only only the builds part, without the landing page bits. There is a new projects page that displays the All Projects table as specified in the design. [YOCTO #6682] (Bitbake rev: c6c7c05521daa9bf16c122d7d472330ca4c05e88) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: protect variable value readsAlexandru DAMIAN
We make sure we don't throw an exception when reading non-existent variables from the database, and we return empty data that can be displayed without ill effects. This fixes the Configuration page on empty builds. (Bitbake rev: 5b13eabdec1e8a052d343fd67654d7fe8974224f) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: refactor objects get in views.pyAlexandru DAMIAN
We refactor the objects.filter()[0] pattern to the proper Django QuerySet usage of objects.get() to make sure we get one and only one object for a query. (Bitbake rev: 6abec6631fbadaecc474f2a4e7981fde3c58657c) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: project edit capabilities in all layers pageAlexandru DAMIAN
This patch definitivates the all layers page, providing interactivity for adding and removing layers inside the project from this page. [YOCTO #6590] (Bitbake rev: e690080f83ad53c5e4a31e8c0fba2cc744eea1eb) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toaster: fix Project page in order to trigger buildsAlexandru DAMIAN
This patch rewrites the Project page and the additional infrastructure in order to fix a bug that makes triggering builds through UI impossible, and to introduce data feeds for suggestions for the user. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toaster: fix layer source update codeAlexandru DAMIAN
We fix problems in the layer source update code related to non-null field restrictions. We add missing layer dependency update. (Bitbake rev: e1169127405ce10a044ac9cdf4a892838a99d01f) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toaster: we add static copies of AngularJS and related librariesAlexandru DAMIAN
We add the Angular JS library, release 1.2.23 https://angularjs.org/ We add the Bootstrap directives for AngularUI, release 0.11.0 http://angular-ui.github.io/bootstrap/ The license ued for all libraries is MIT (Bitbake rev: 8b4d33a6182486795cca53b2832967de583281e1) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: update breadcrumb in analysis pagesAlexandru DAMIAN
If we are in managed mode, and we inspect a build that comes from a project, we modify the breadcrumb as to display the project from where the build originated. [YOCTO #6776] (Bitbake rev: fe568c9350a691c863f9f5bf8703d639c12a9961) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toasterui: save build id in build request on first chanceAlexandru DAMIAN
We change the saving of the build id to the build request as soon is the build is created, as to allow for a consistent display of build data while build is in progress. (Bitbake rev: 9504ca6a69ba6da21f88b3cc77fa5910d886b6c3) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: Show failed tasks in the build dashboardBelen Barros Pena
The build dashboard is supposed to show failed tasks (if any) in the "Tasks" section. (Bitbake rev: fc2a7be3982ea5441beef1b7e9e187caf5df2beb) Signed-off-by: Belen Barros Pena <belen.barros.pena@linux.intel.com> Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: Tiny change to help textBelen Barros Pena
Modify the help text we show for the "Task covered by" information to indicate that a task can be covered by more than one task. (Bitbake rev: cad45dfebaabe1875f786ba7ceeb3ee377e926b3) Signed-off-by: Belen Barros Pena <belen.barros.pena@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: Remove extra <div> from build dashboardBelen Barros Pena
For builds that generate no rootfs files, an extra <div> was being added between the build status and the build summary section. This commit removes the extra <div> and the white space it created. (Bitbake rev: e84db294f733464b4952a3c92120e5b19e8c2750) Signed-off-by: Belen Barros Pena <belen.barros.pena@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: Remove sorting from "Size over total" columnBelen Barros Pena
The sorting in this column is tied to the sorting by "Size". If we make both columns sortable, when you sort by one of them it also sorts the other, and the table looks as if you have sorted by 2 columns at the same time. This was fixed in YOCTO #6061, but turned up again. (Bitbake rev: acf372eb5a083451ab1507dd24e3a84380420c9a) Signed-off-by: Belen Barros Pena <belen.barros.pena@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: Fix blue highlight for failed tasksBelen Barros Pena
Change the background colour of table rows with the .error class from white to transparent, to make sure the blue highlight animation works when you click on the order number in the task details page. (Bitbake rev: 25fd347b6a972164af9a0b5b56f803a296290246) Signed-off-by: Belen Barros Pena <belen.barros.pena@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: Fix reverse dependencies tab for packages includedBelen Barros Pena
Make sure the reverse dependencies tab for included packages shows a notification when the number of reverse dependencies is 0, instead of an empty table. (Bitbake rev: 8dc3e582eb5f1d6e9a79de59a53014495a48e862) Signed-off-by: Belen Barros Pena <belen.barros.pena@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: Add missing task descriptionsBelen Barros Pena
The "Prebuilt task could be based on" table we provide in the task details page for prebuilt tasks is missing the task descriptions. This patch adds them. [YOCTO #6328] (Bitbake rev: 64894d640ee70a301f6f399db118ed17c0ccde08) Signed-off-by: Belen Barros Pena <belen.barros.pena@linux.intel.com> Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: Amend show rows optionsBelen Barros
In the templates basetable_bottom.html and basetable_top.html remove the '2' and '5' options from the 'show rows' menu, and add the '150' option as per design specs. Alex edited conflicts. (Bitbake rev: 03f7ba3d8a101e05c106e5fb65eb379a6e4cb476) Signed-off-by: Belen Barros <belen.barros.pena@intel.com> Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toastergui: Fix help text in packages 'Reverse runtime ↵Belen Barros Pena
dependencies' tab For those packages renamed at packaging time, the help text in the 'Reverse runtime dependencies' tab was missing the original package name. [YOCTO #6327] (Bitbake rev: ca8fc7bd4ad940c8eeefa57619a6c8423f116fc7) Signed-off-by: Belen Barros Pena <belen.barros.pena@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: toasterbld: update checksettings commandAlexandru DAMIAN
We update the checksettings command to allow for upstream git url detection at runtime by looking up a named remote of a local repository. Also various small fixes in check settings. (Bitbake rev: c127ecb3b5b27b705b8714af063d910b944c8bbc) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-30bitbake: buildinfohelper: Make sure we use the orm defined value for loglevelMichael Wood
We need to consistently use LogMessage.INFO/WARNING/ERROR to make sure toaster knows how to categories these rather than passing in the "raw" loglevel value which in best case comes from python logging but worst case any value. [YOCTO 6885] (Bitbake rev: 3aa13bc1d8218c97c76581a895fa5f03ff807fbe) Signed-off-by: Michael Wood <michael.g.wood@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-28bitbake: prserv: don't wait until exit to syncBen Shelton
In the commit 'prserv: Ensure data is committed', the PR server moved to only committing transactions to the database when the PR server is stopped. This improves performance, but it means that if the machine running the PR server loses power unexpectedly or if the PR server process gets SIGKILL, the uncommitted package revision data is lost. To fix this issue, sync the database periodically, once per 30 seconds by default, if it has been marked as dirty. To be safe, continue to sync the database at exit regardless of its status. (Bitbake rev: 424df64f2e9679043f0ce2b4f7dfc59c3d404304) Signed-off-by: Ben Shelton <ben.shelton@ni.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-28bitbake: utils.py: don't use len() for truth value testing.Oscar Utbult
(Bitbake rev: 4bdfeab7845bdcd62a4928200dd13701414a464e) Signed-off-by: Oscar Utbult <oscar@oscr.io> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-28bitbake: fetch2: add .lz compression supportKoen Kooi
See http://www.nongnu.org/lzip/lzip.html for details on the compression format. (Bitbake rev: 9027b1273b5405c7269b013604ab417771b5eafe) Signed-off-by: Koen Kooi <koen@dominion.thruhere.net> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-11bitbake: fetcher: fix getVar call due to incorrect argument datatypeAlejandro Hernandez
(Bitbake rev: 2ac33aac3446cb12227f1b8daa5f27f417c9bb9e) Signed-off-by: Alejandro Hernandez <alejandro.hernandez@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-10-06bitbake: fetcher: fix BB_STRICT_CHECKSUM datatype checkAlejandro Hernandez
Forcing strict to be a string, to avoid problems when performing comparisons [YOCTO #6762] (Bitbake rev: b8ed2098bdea2afd93ab4e3e1b834f3a31cb60de) Signed-off-by: Alejandro Hernandez <alejandro.hernandez@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-29bitbake: toastergui fix size rendering in dirinfo pageAlexandru DAMIAN
We fix the rendering of the size field in dirinfo-related pages by directly calling filtered_filesizeformat and not rendering it through the template engine. Additionally, we enable error dumping into logs if an Exception happens. [YOCTO #6669] (Bitbake rev: afa2431c21b8271b05dc4cca4265f98d9f338007) Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-29bitbake: prserv/serv: Improve error message when prserver cannot bind to ↵Konrad Scherer
supplied host address If localhost resolves to a remote address (due to a misconfigured network), starting the pr server will fail without useful information. To reproduce, add '<bogus ip> localhost' to /etc/hosts and run 'bitbake -p'. The error message will be: ERROR: Timeout while attempting to communicate with bitbake server ERROR: Could not connect to server False: Running 'bitbake-prserv --host=localhost --port=0 --start' will fail with: error: [Errno 99] Cannot assign requested address Since these errors does not show the IP address of the attempted socket binding, this results in a lot of wasted time looking at firewall rules, etc. This patch results in the following error message if the socket binding fails: PR Server unable to bind to <bogus ip>:0 (Bitbake rev: fae5914030bcf4c061c22fc61034c40c87b7121a) Signed-off-by: Konrad Scherer <Konrad.Scherer@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-29bitbake: hob: Fix sstate mirrors manglingRichard Purdie
hob was adding the redundant characters "\1" in SSTATE_MIRRORS variable. If needed it is expected the user will add this instead so remove the code that was doing this. [YOCTO #6600] (Bitbake rev: 73bf120062fc00c7e26dc4e77a7d140658d89daf) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-29bitbake: fetch: Extend testing of subdir unpack parameter and fixRichard Purdie
This fixes urls of the form file://some/path/file;subdir=b. It also adds in a couple of tests so we now tests these corner cases. (Bitbake rev: 46306912a96444790efa9418d934dfdd36773ba1) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-29bitbake: fetch: SRC_URI parameter "subdir" does not work for local filesRoxana
Check if the 'subdir' parameter exists and assign it to 'destdir' so that files are copied in ${WORKDIR}/destdir. This fixes urls that are of the form file://a;subdir=b. (Bitbake rev: 836a986b365eb9798563ec08d90b346596de7791) Signed-off-by: Roxana Ciobanu <roxana.ciobanu@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-29bitbake: monitordisk: don't log when not monitoring a filesystem for inodesRoss Burton
Writing a log that the filesystem isn't being monitored for inode usage just confuses users who are not aware about the nature of inodes in their filesystem, so don't say anything, just silently disable the monitor. In general this only happens on filesystems which don't have a limit on inodes. (Bitbake rev: ca93bc84ee5fb94a50c11c47e4d212d7da649e24) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-23bitbake: bin/bitbake: Update to version 1.24.0Richard Purdie
(Bitbake rev: 637ce8df2658e4905fab8a0600a45505596bf472) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-23bitbake: fetch2/perforce: Use replace (1 line) instead of find (3 lines)Chad Nelson
(Bitbake rev: 5bf5a937b26896bedbfea78dd1d62bce5a26ac2a) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-23bitbake: fetch2/perforce: Fix localfile name if labels are usedChad Nelson
I could apply the label "release_1.0" to a super project that contains many sub projects. If my recipes have SRC_URI's that use that label but grab different sub-folders, than there's a bug where the cached localfile (tar.gz) will not be unique and reused at the wrong times. SRC_URI = "p4://perforce::1234@//depot/SuperProject/MiniProjectAAA/...;label=release_1.0 \ p4://perforce::1234@//depot/SuperProject/MiniProjectBBB/...;label=release_1.0" (Bitbake rev: 3b5b1703b77490116dda895b29737cea51a3d6a0) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-23bitbake: knotty: Ensure commandline parameters are updated in memres serverRichard Purdie
When using options like -k, -f, -v and so on with the memory resident server, they'd currently only be set on the initial values passed to the original command. This ensures they now match those specified on the commandline for the options where this makes sense. To make this work, a command to update the options on the server side is required so this is added. [YOCTO #5292] (Bitbake rev: 1c75cc4d0c8b606c1fe76e6bf60bf6a32298b105) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-22bitbake: bitbake-worker: Fix bitbake -nRichard Purdie
Without this you see: File "bitbake/bin/bitbake-worker", line 201, in fork_off_task os._exit(child()) TypeError: an integer is required (Bitbake rev: cd477b5e77ab0373248b8a8fa30e1c7b8ea984fd) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-16bitbake: data_smart: Clarify what 'computed' means in the data store history ↵Richard Purdie
context (Bitbake rev: a2ca038dd1d0be4e0a0b20ae16a467d5a0075514) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-13bitbake: data_smart: Fix remove operator and its interaction with data expansionRichard Purdie
If you have: FOO = "${bindir}/X Y" FOO_remove = "${bindir}/X" the expected result is "Y". Currently this doesn't work since the removed expressions are not expanded first. This patch adjusts things so the expressions are expanded before being processed for removal. Also add a test to ensure this case continues to work. [YOCTO #6624] (Bitbake rev: 72a1ca4a104ccab73d6abcbd44db9c2636a58572) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-09-11bitbake: bin/bitbake: Update to version 1.23.2Richard Purdie
(Bitbake rev: e24095f54c52a547c0462836586a5d716249036e) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>