summaryrefslogtreecommitdiffstats
path: root/bitbake
AgeCommit message (Collapse)Author
2012-08-30bitbake: taskdata: Don't add dependencies on tasks that don't existRichard Purdie
"bitbake meta-toolchain" with qemu image testing enabled causes problems since it adds a task after do_rootfs which doesn't exist in this case. We should simply ignore these extra dependencies rather than adding them in which is what this patch does (adding a debug message when this happens). (Bitbake rev: 843d3d6b0a7eb2e2f7b50c555767f5385df16ede) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-30bitbake: bin/bitbake: Clarify wording in help output for -sTrevor Woerner
The '-s' option shows (input) recipes, not (built/output) packages. Clarify the help wording for this option so it is consistent with how bitbake defines recipes and packages. (Bitbake rev: 0cac6d647c58ae449323959220775fc1afd5bfb0) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-23bitbake: ast: Store anonymous python function contents in the datstoreRichard Purdie
This is useful if we need to disable part of one during a backtrace for debugging purposes. (Bitbake rev: 80a0c1b06a30a6ba9977c29fac0437a208d8cbbc) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-23bitbake: ast: Extract text variable in PythonMethodNodeRichard Purdie
(Bitbake rev: 2e98f740b4a57a3467b1a00b1ebc1aaee33a8ff0) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-23bitbake: ast: Rename PythonMethodNode define variable to modulenameRichard Purdie
It was hard for me to understand what the define variable was, modulename is hopefully a bit better. (Bitbake rev: 79f9f46319de85f85613ebe248c327f5852225ba) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-23bitbake: methodpool: Clean up the parsed module list handling to be slightly ↵Richard Purdie
less insane This removes some dubious functions and replaces them with a simpler, cleaner API which better describes what the code is doing. Unused code/variables are removed and comments tweaked. (Bitbake rev: f1e943aebfb84e98253f3f21646d6765c4fa1d66) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-23bitbake: methodpool: Remove unused check_insert_method functionRichard Purdie
(Bitbake rev: 4664333e55ffc9d618f2c2f074200923209fd6c4) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-23bitbake: cooker: Add explict handling of BBHandledException for parsing failuresRichard Purdie
This removes some unnecessary tracebacks (Bitbake rev: db0ff7b4d47fce8322dd2350a2b1a6f60ef61d25) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-23bitbake: cooker: Ensure parsing failures stop the buildRichard Purdie
Currently parsing failures still allow bitbake to continue on and try and execute a build. This is clearly a bad idea and this patch adds in more correct error handling and stops the build. The use of sys.exit is nasty but this patches other usage in this function so is at least consisent and its better than the current situation of trying to execure a half parsed set of recipes. There are probably better ways this could be improved to use to stop the build. (Bitbake rev: 22756e9c0f1da33ba2c6e881b214577a610b7986) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-23bitbake: utils.py: Once we've printed errors messages, suppress the backtraceRichard Purdie
Adding a generic backtrace to better_compile and better_exec is pointless, therefore reraise the exception as a bb.BBHandledException so the generic code doesn't confuse the user even more. (Bitbake rev: b3d97130e1e70fe969399277dcd7cccd888103d6) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-23bitbake: utils.py: Try harder to extract good traceback information by ↵Richard Purdie
querying the datastore Currently as soon as execution passes outside the code fragment being executed by better_exec, we don't get any good traceback information, just a likely obscure reference to some function name which may or may not be identifiable. This patch adds code to query the datastore if present, allowing a more meaningful back trace to be displayed in many cases. [YOCTO #2981] (Bitbake rev: 0edf8431f9ff52581afe0d3ef525c59909af02ba) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-23bitbake: cooker: fix traceback when using -b with skipped recipePaul Eggleton
If a recipe is skipped during parsing for whatever reason, check and report this as an error rather than trying to use the data that is sent back and failing. Fixes [YOCTO #2976]. (Bitbake rev: a324df40243fa55ccc89fd5970d46f25330d0a0d) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-22bitbake: event/ast: Use better_exec instead of simple_execRichard Purdie
This improves the stacktraces dumped by bitbake when for example anonymous python functions fail. Also default to passing code strings to better_exec to match the behaviour of simple_exec to aid the transition. (Bitbake rev: 7e8205929ae953731a6854ea80b197847cff5771) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-22bitbake: ui: Improve error message if bitbake cannot import python curses moduleKonrad Scherer
On some SuSE systems, the curses python module is not installed by default. Instead of a python failure, we want a nicer error message. (On SuSE systems the package is typically python-curses.) (Bitbake rev: 65a5845ac942d0aa6838c295e41b656f9d2a98bb) Signed-off-by: Konrad Scherer <Konrad.Scherer@windriver.com> Signed-off-by: Jeff Polk <jeff.polk@windriver.com> Reword commit message, rebase to latest bitbake. Signed-off-by: Mark Hatle <mark.hatle@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-22bitbake: bitbake-layers: use parsable title for show-appendsPaul Eggleton
Print title text surrounded by === as we do with other subcommands so that you can filter it out in scripts. (You will also want to filter out lines starting with "WARNING:" if you just want the list). (Bitbake rev: ba15ba16a5d863886bcfd5b3f0bdfff2a6de11a0) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-22bitbake: bitbake-layers: avoid full parse for show-layers subcommandPaul Eggleton
We don't actually need to parse all recipes just to show the configured layers, so just parse the configuration instead. (Bitbake rev: 406477cbae066b6379873e266cb79801e545a61c) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-22bitbake: bitbake/cooker: minor refactor of parseConfiguration()Paul Eggleton
All calls to parseConfiguration set self.status and call self.handleCollections() afterwards, so just do this inside parseConfiguration() itself. (Bitbake rev: 3c2322d8a6ce15e20adb07a61aa321d884a9bcca) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-22bitbake: data_smart: skip all interal (underscored) flags in getVarFlagsRoss Burton
(Bitbake rev: 9f631e29a2eebb96a8291839dd8b39aa9126a10e) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-22bitbake: data-smart: rename the 'content' internal variable to '_content'Ross Burton
(Bitbake rev: 684cf09aed09ec82c8afb99895f92d73cd0519df) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-22bitbake: Hob wizard-like reorganizationCristian Iorga
Hob is now more context-sensitive regarding user changes/options. Also, the workflow have been streamlined and resembles more of a wizard. Beautified some hardcoded values. Fixed typo. New streamlined Image Configuration page. Build and/or Edit image buttons presence is context sensitive. Recipes and packages tabs selected automatically based on custom image or pre-defined target image (included or all). Context sensitive Back button. Fixes [YOCTO 2165] (Bitbake rev: b48cd7dcf57b1abc8c5b46ced11d4f57bf06e557) Signed-off-by: Cristian Iorga <cristian.iorga@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-22bitbake: bitbake: hob: create console log directory before writingPaul Eggleton
The default value of BB_CONSOLELOG in OE-Core now points to a directory that might not exist prior to the first build, so ensure it is created first. (Bitbake rev: 660821769b9dfb89086291ffc835e9b5444509be) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-18bitbake: build.py: Correct package to recipe in TaskBase events to use ↵Richard Purdie
consistent terminology (Bitbake rev: e5045429bce15b66c4355be214db3982ac7761f3) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-18bitbake: fetch2/git: Work around git confusion between foo.git and foo ↵Richard Purdie
repositories If you have foo and foo.git in GITDIR, the two can end up being confused by git with some horrible union of the two being cloned. This adds a workaround to avoid this happening until git 1.7.9.2 onwards is common enough for this to be removed. We use a symlink to hide the directories we don't want git to know about. (Bitbake rev: bbf1f6fe594c721a296ca09ee7c583d4a205c591) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-17bitbake: really remove knotty2Richard Purdie
(Bitbake rev: 587ce3bd76b5338c538dc9a5b9f06d42cb5ae3eb) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-17bitbake: bin/bitbake: Remove knotty2 from the list of valid interfacesRichard Purdie
(Bitbake rev: e0f91faf195be63803d39fb42fcd115ad558c79f) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-16bitbake: bitbake: build.py: Add stampdir argument to cached_mtime_noerrorAndrei Gherzan
After commit 2718537b4b04eb3d80ab4d74171b58e7b8dd68b8 (bitbake: build.py: Only execute mkdirhier if stampdir doesn't exist) build failes as cached_mtime_noerror needs an argument - stamp dir. This argument was forgotten. (Bitbake rev: e69103c4f7e45c24f1fbe9df0383f39e877abcb4) Signed-off-by: Andrei Gherzan <andrei.gherzan@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-16bitbake: knotty: Fold knotty2 into knotty and make it the defaultRichard Purdie
There is no good reason knotty2 shouldn't be the default now. If you need the old behaviour, just pipe the output through cat as non-interactive terminals get the old output. (Bitbake rev: b97d50618b2187bcfd7d25f64d1444482ca62ef7) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-16bitbake: knotty2: Handle long lines of text and terminal window size changesRichard Purdie
Long lines of text which wrapped on the terminal corrupted the output shown by knotty2. This patch catches such errors by becomming aware of the terminal size. It also catches terminal window size change events and adapting to those changes using a signal handler. Based on a patch from Jason Wessel with several tweaks and enhancements such as use of chained signal handlers and covering all output messages. (Bitbake rev: 9afc9e4d14abec5ac326851d4bb689c1e8d45a43) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-16bitbake: build.py: Only execute mkdirhier if stampdir doesn't existRichard Purdie
I noticed this was showing up on profile logs as a sigificant time user in "bitbake bash" when bash was already built. It reduces the time from 5.2 to 4.5 seconds in my test environment. We make use of the parser's mtime cache as once a directory exists, we can assume it continues to exist and this avoids syscalls. (Bitbake rev: 769b694eeb617bb793bd79d0d7b29c43d2646ece) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-16bitbake: bb/ui/uihelper.py: Ensure task current and total numbers are ↵Richard Purdie
updated for setscene events too This avoids task (0 of 0) type messages being displayed during setscene by knotty2. (Bitbake rev: 53efa01720a61da2cb344cbb7e977baa28deba3b) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-16bitbake: knotty: Chain the WINCH signal handler in progressbar so any other ↵Richard Purdie
handler is preserved and called (Bitbake rev: 7753e075dbeee471b9ceb34f1e3165aa656932ed) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-03bitbake: data_smart: Fix unanchored regexp causing strange parsing issueRichard Purdie
If this regular expression is unanchored, it would accept strings like: do_install_append1 do_install_appendsomelongstring and treat them like they were do_install_append. Clearly this isn't desirable. Only one instance of this type of issue was found in OE-Core and has been fixed so correcting the regexp should be safe to do. (Bitbake rev: 23bd5300b4a99218a15f4f6b0ab4091d63a602a5) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-03bitbake: Fix script location after mishandled mergeRichard Purdie
(Bitbake rev: 0f3293c2196a30bc52bf1eebfae87d8477880572) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: cooker: fix OVERRIDES in BB_SIGNATURE_HANDLER (to override value ↵Martin Jansa
from DISTRO.conf from local.conf) We really need to pass the finalised data store into the parser init function (and hence the siggen init function). This ensures any value changes get passed into the correct code. (Bitbake rev: 19efc6081c15a59bb8f5aaf8478650a2732cafe8) Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: fetch2/local: Add search paths to the debug log to improve log ↵Richard Purdie
usefullness (Bitbake rev: 2054c7d99933c1523d4b5c7f65d37c69b8472e47) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: fetch2/local.py: Provide better debug output when fetch of a local ↵Richard Purdie
file fails When a fetch failure occurs for a local file, this patch ensures we print the locations searched making it easier for the user to debug the problem. (Bitbake rev: a461adbc5f09b41c771a7603370f6f2d1299ae8e) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: runqueue.py: Clean up runqueue exception catching in the normal ↵Richard Purdie
task failure case (Bitbake rev: a0bc58031d4eb31f8587171e870ecad059af5098) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: contrib/dump_cache.py: dump recipe -> packages mapping from ↵Robert Yang
bb_cache.dat Add the dump_cache.py to dump the "recipe -> packages" mapping for target recipes form bb_cache.dat: * Usage: dump_cache.py bb_cache.dat * The format is: recipe_path pn pv packages For example: /path/to/gzip_1.5.bb gzip 1.5 gzip-dbg gzip-staticdev gzip-dev gzip-doc gzip-locale gzip * Only save the mapping for the target recipe * We can extend this to dump other informations when needed. * Put this script to bitbake/contrib/ (not to oe-core) is because it needs the bb.cache. [YOCTO #2741] (Bitbake rev: 75a7caf6f2d9f4399c95b9249db1b3bc5a48dc61) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: bitbake-layers: fix help for show-overlayed to match behaviourPaul Eggleton
show-overlayed actually lists the same recipe in multiple layers regardless of priority, so change the help description to match. (Bitbake rev: 17217ff707e41780cb473b9cdd2621dd18b982c2) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: Hob: change the Build failure scenario as ui designLiming An
As ui design 'build-fail-spec.pdf' to change the GUI [YOCTO #2183] (Bitbake rev: f9b81e44b2e71b4de6729bd2c69b25fd619b5fed) Signed-off-by: Liming An <limingx.l.an@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: Hob: log for Hob and allow users to show logs after successful buildLiming An
If users build images in Hob, record logs and allow users to retrieve the lo after successful build. The logs are generated if and only if: - users do "just bake" - users do "build image" after "build packages" - users do "build packages" only [YOCTO #1991] (Bitbake rev: 291289787bb042b99f0599babc2d67c220aadb87) Signed-off-by: Shane Wang <shane.wang@intel.com> Signed-off-by: Liming An <limingx.l.an@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: fetch2: print checksums when they are different then expectedMartin Jansa
* in form which can be copied into a recipe without modification * like oe-classic did since: http://git.openembedded.org/openembedded/commit/?id=68abc465559a68e9201c9525be3c4acc6297eaed * it shows them in right form when they are missing completely, but in more verbose form when different * it needs to print that only when checksums were requested, e.g. fetching from sstate mirror sets both md5mismatch and sha256mismatch, but your checksums shouldn't be shown (Bitbake rev: 9eb34fc866775fd8310759a0111f232a9dc98981) Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: fetch2: handle broken symlinks in local mirror handlingChristopher Larson
If a file:// mirror is being used, the fetcher will create a symlink to the local file. However, if the local file gets removed, that link will be dead, and os.path.exists() returns False in that case, so it tries and fails to recreate the link. Now we unlink such a dead link if it exists. (Bitbake rev: 229ed3857e826e3e215e843cb51f729c1e13ed37) Signed-off-by: Christopher Larson <chris_larson@mentor.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: knotty: ensure that directory for BB_CONSOLELOG exists before using itMartin Jansa
(Bitbake rev: 1e06d8012868ba5a31503dc99cbf18570be629d9) Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: fetch2/__init__.py: Add NoChecksumError exceptionMark Hatle
Without the new exception, when the system is configured to use premirrors, but not allow network access (via BB_NO_NETWORK), when a recipe was lacking a checksum the wrong error message(s) were being generated. Instead of complaining about trying to perform network access, if the system was able to find the item in the premirror, it should inform the user of the lack of checksums, and the two SRC_URI fields they should use to update their recipe. (Bitbake rev: cb10e9c03a3f96d94e27e18330009616dde5e2b3) Signed-off-by: Mark Hatle <mark.hatle@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: hob: deal event DiskFullKang Kai
Part of [Yocto #2168] When bitbake runqueue is teminated by disk monitor, it will send event DiskFull. Update to handle it. (Bitbake rev: a691de10d8b8de552628b277e78d47c607ee3a46) Signed-off-by: Kang Kai <kai.kang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-08-02bitbake: monitordisk: fire event DISKFULL when terminate buildKang Kai
Part of [Yocto #2168] Add a event DiskFull to descript the termination by disk monitor. Update check() to fire the event DiskFull when terminates the build. This could help UIs to deal this scenario and show more information to end user. (Bitbake rev: 0a0fca3d94a1db6458ae21501a66461a334410ed) Signed-off-by: Kang Kai <kai.kang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-07-26bitbake: fetch/local: Allow preservation of path components in relative ↵Richard Purdie
file:// urls This enhances the fetcher to allow preservation of the path component in urls like: file://xxx/yyy/somefile.patch. (Bitbake rev: e49a656a499355a5c6e7eb00bf5b8f1795e8dddb) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-07-26bitbake: runqueue.py: Wipe out the stamp cache between setscene and main ↵Richard Purdie
task execution The stamp files can change during setscene and the cache should be cleared to account for this. (Bitbake rev: 5ec12f586a50fce675b268965b3dc487aaa96c43) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-07-26bitbake: runqueue.py: Allow the setsceneverify function to have a list of ↵Richard Purdie
tasks that are invalid and need to run There was some odd behaviour if some task was run from setcene whilst there were existing valid stamps for a depepdency. For example, do_populate_sysroot might be installed at setscene time but if there were other tasks not installed from setscene such as do_populate_lic which depend on do_configure, the setsceneverify function would think that do_configure needed to be rerun and would hence void the do_populate_sysroot and force that to rerun too. The setsceneverify function needs to know which tasks are going to be rerun, not just what the overall task list is and what setscene functions have run. This patch adds that information and maintains backwards compatibility in a slightly ugly but effective way. The metadata needs updating to take advantage of this change. (Bitbake rev: 1423aafff97f17169e95ec3ba973eb002ff98c1c) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>