path: root/bitbake
AgeCommit message (Collapse)Author
2012-07-17bitbake: hob2: add elf to hcc supported image types1.3_M2.final1.3_M2Kang Kai
[Yocto #2709] OE Core Commit c9b01af84b64edba056f959c349895e0698324e6 add elf image type. This will cause hob build image failed. Add elf to hcc supoorted image types to fix this issue. (Bitbake rev: a93a58b7cea2ddb9596cb4d718c0801db5d1a295) Signed-off-by: Kang Kai <> Signed-off-by: Richard Purdie <>
2012-07-11bitbake: fetch2/ Warn user if SRC_URI is using "proto" and not ↵Andrei Gherzan
"protocol" As well, if "proto" is used, get the associated value as "protocol" (Bitbake rev: 53e6b630f0463d2d07cdaa9c9eb36794dc9b6b69) Signed-off-by: Andrei Gherzan <> Signed-off-by: Richard Purdie <>
2012-07-11bitbake: fetch2/ Use "protocol" parameter to get the protocolAndrei Gherzan
(Bitbake rev: 630876b40ed181312e84f902c4cfb97361afbe81) Signed-off-by: Andrei Gherzan <> Signed-off-by: Richard Purdie <>
2012-07-11bitbake: fetch2/ Use "protocol" parameter to get the protocolAndrei Gherzan
(Bitbake rev: f4a780a7f50fdd8f2bd75888dad790bcfe95b873) Signed-off-by: Andrei Gherzan <> Signed-off-by: Richard Purdie <>
2012-07-11bitbake: fetch2/ Use "protocol" parameter to get the protocolAndrei Gherzan
(Bitbake rev: 01040efce82cfbaa76f46d9f95c984be8f9ea810) Signed-off-by: Andrei Gherzan <> Signed-off-by: Richard Purdie <>
2012-07-11bitbake: bitbake: Abort build if runtime dependency conflictWenzong Fan
Currently if there are multiple preferred providers available for a runtime dependency, bitbake will print an Error message and let the build go on. Anyways the build should abort while any Errors occured. [YOCTO #2734] (Bitbake rev: 5f81a714f4fca785780bef555b419f0250e5ec1c) Signed-off-by: Wenzong Fan <> Signed-off-by: Richard Purdie <>
2012-07-10bitbake: fetch2/wget: Use FETCHCMD_wget to provide the commandline and optionsRichard Purdie
This also changes to use -t 2 -T 30 as the defaults which are more sane for a modern fetcher and already specified in OpenEmbedded metadata. (Bitbake rev: bf0e5dddf0f63cdb0648fb6d872af5ceef6fbfb0) Signed-off-by: Richard Purdie <>
2012-07-10bitbake: fetch2/ Switch to use FETCHCMD_cvs and handle parameters in ↵Richard Purdie
the fetcher itself This brings the cvs fetcher more into line with the others and allows consistent usage of the FETCHCMD variable and option handling. (Bitbake rev: 390ad59739356422852e976fa246375abc6aba08) Signed-off-by: Richard Purdie <>
2012-07-09bitbake: bitbake/cooker: Print which pkgs would be built in -g outputRobert Yang
This is for giving the user a clear list to show which pkg would be built, we have the "bitbake -g", but it is not easy to read for people, it is for "dot". Improve the "bitbake -g" to also save a pn-buildlist: $ bitbake -g core-image-sato ... NOTE: PN build list saved to 'pn-buildlist' [snip] The contents of pn-buildlist: busybox shadow-native pth sysfsutils qemu-helper-native curl-native ncurses-native gdbm xserver-xorg linux-libc-headers [snip] [YOCTO #2404] (Bitbake rev: 18aff925aece774d0172894e25584353519ca03f) Signed-off-by: Robert Yang <> Signed-off-by: Richard Purdie <>
2012-07-06bitbake: usermanual: Fix missing markupRobert P. J. Day
(Bitbake rev: 68af2b09315ba35eae24933a599014a662789c2c) Signed-off-by: Richard Purdie <>
2012-07-05bitbake: data_smart: Fix multiple override interaction with append and ↵Richard Purdie
prepend operators Variables which used multiple overrides and the append/prepend operators were not functioning correctly. This change fixes that. This fixes the testcase: OVERRIDES = "linux:x86" TESTVAR = "original" TESTVAR_append_x86 = " x86" TESTVAR_append_x86_linux = " x86+linux" TESTVAR_append_linux_x86 = " linux+x86" [YOCTO #2672] (Bitbake rev: dc35a2e506e15fb7ddbf74c3b3280e9e83ab33bb) Signed-off-by: Richard Purdie <>
2012-07-04bitbake: Fix recursive task pruning to only prune self ↵Richard Purdie
referencing tasks (Bitbake rev: 4962a59793504b26b06cf058dda600a07fbbd951) Signed-off-by: Richard Purdie <>
2012-07-04bitbake: fetch2/svn: Enhance to cope with subversion 1.7 upgradeRichard Purdie
svn changed working checkout formats between 1.6 and 1.7. Its convoluted to detect what format a given working copy is in so the simplest solution is simply to run "svn upgrade" within the working copy. The base svn command variable is relocated slightly to enable this new code to work effectively. (Bitbake rev: ebd3ecdb5f3c6d3fe1fad27cbed4d80f4277e92e) Signed-off-by: Richard Purdie <>
2012-07-04bitbake: usermanual: Improve task dependency documentation to match realityRichard Purdie
(Bitbake rev: f67c0606fc681359fb0c68be55cfc9f11d410f17) Signed-off-by: Richard Purdie <>
2012-07-04bitbake: Allow recrdeptasks that have self referencesRichard Purdie
In some cases we want to pull in DEPENDS and RDEPENDS of recrdeptask dependencies but we need a way to trigger or avoid this behaviour depending on context. The logical syntax to trigger such behaviour would be a self referencing recrdeptask: do_a[recrdeptask] = "do_a do_b" The dependency chains already recurse this kind of expression correctly, the missing piece is to avoid any circular reference errors. Since the dependencies have already been recursively resolved, simply removing any recrdeptask references is enough to break the circular references. This patch therefore removes any circular references using the set difference_update() operator. There will be metadata tweaks required to add any references needed to the extra taskname. (Bitbake rev: a5324da9b8a0c9307a6c511ea9009f34be70c92b) Signed-off-by: Richard Purdie <>
2012-07-04bitbake: Hob: fixed some variables not clean bug in detail pageLiming An
[YOCTO #2679] (Bitbake rev: 73801f571e040dcdfeb15a15b9a484cbefaae70c) Signed-off-by: Liming An <> Signed-off-by: Richard Purdie <>
2012-07-04bitbake: git: do not execute 'git remote prune'Enrico Scholz
'git remote prune' at this location does not make much sense because the following 'git remote rm' will prune stale and non-stale branches. The 'prune' can cause trouble because it will access the network bypassing the no-network code in bitbake. When this operation fails and throws an exception, the next command (--> 'git remote rm') will be skipped. This in turn, will make all the following operations fail, because they assume that the remote does not exist yet. (Bitbake rev: 2ba23df5fad4b94d38a6aed97f7822226d72eb89) Signed-off-by: Enrico Scholz <> Signed-off-by: Richard Purdie <>
2012-06-29bitbake: Hob: change 'run image' and 'deploy' Gui and work flow for building ↵Liming An
detail page In build detail page, the response action of clicked the 'run image' or 'deploy' button will accroding to below as ui design: 1)if there has one file in building result, it will responsed the 'run image'(now, we only support the qemu) or 'deploy' directly 2)if there has more than one file, it will popup a dialog with listed created files type, they are has same action attributes 'deploy' or 'runnable'. Note: because the qemu image (runnable file) can't be deployed and we can't generated a image that has the two attributes now, can be run or can be deployed, so the code will not deal with this case. [YOCTO #2155] (Bitbake rev: 0d24b1e85a11b68c8464cf15b49d3fc78f216818) Signed-off-by: Liming An <> Signed-off-by: Richard Purdie <>
2012-06-28bitbake: Handle multiple rdeptask entriesRichard Purdie
I'm not sure why we don't currently allow multiple entries in rdeptask when we do in deptask. This makes the handling match between the two since its trivial to fix. (Bitbake rev: 19c84fe8854639768c874cc1449963a9867ad397) Signed-off-by: Richard Purdie <>
2012-06-28bitbake: fetch2: Revert the regexp removal for the type field and instead ↵Richard Purdie
anchor regexp People are using regexps in the url type field so we need to preserve this bitbake behaviour. To address the issues with https:// urls mapping badly to file:// urls we anchor the regexp if its not already anchored. There should be no expressions in the wild which would break with this change. (Bitbake rev: ce0579dc256251e523c6330641f98b9f5a0e5761) Signed-off-by: Richard Purdie <>
2012-06-28bitbake: test/fetch: Switch the comparision order to make test failures ↵Richard Purdie
slightly clearer (Bitbake rev: 2b1311e21172847b6a86cfb21a84fd00e4ab1ac5) Signed-off-by: Richard Purdie <>
2012-06-28bitbake: test/fetch: Ensure cwd is valud for the git cloneRichard Purdie
(Bitbake rev: 60b1a9f52dfec98e55a879a637f7142b0175b452) Signed-off-by: Richard Purdie <>
2012-06-28bitbake: runqueue: Reimplement recrdepends so it works more correctlyRichard Purdie
Currently, recrdepends is extremely greedy. For example: do_foo[rdepends] = "somedep:sometask" addtask foo which adds foo with *no* dependencies, will suddenly start appearing as a dependency in every task which uses recrdepends. So far this has been mildy annoying but we now have use cases where this makes no sense at all. This reworks the recrdepends code to avoid this problem. To do this we can no longer collapse things into lists just based on file ID. The problem is this code is extremely performance sensitive. The "preparing runqueue" phase spends a lot of time in these recursive dependency calculations so any change here could negatively impact the user experience. As such, this code has been carefully tested on convoluted dependency trees with operations like "time bitbake world -g". The net result of this change and the preceeding changes combined is a net speed up of these operations in all cases measured. Tests were made comparing "bitbake world -g" before and after this patch. There *are* differences for example -nativesdk do_build dependencies on -native recipes are no longer present. All removed dependencies appear to be sensible improvements to the system. The "rdepends" cross contamination issue above is also fixed. (Bitbake rev: 82d73423c57569b984ee0ae3d93e3c3bd5dc5216) Signed-off-by: Richard Purdie <>
2012-06-28bitbake: Convert depends variable to use setsRichard Purdie
This gives some small performance gains and sets the scene for other improvements by removing the need for duplicate detection code. (Bitbake rev: 6fd723479e8d49227fd58040b3485c1d5afc4bc5) Signed-off-by: Richard Purdie <>
2012-06-28bitbake: taskdata: Add gettask_id_fromfnid helper functionRichard Purdie
This is like gettask_id but doesn't require translation of fnid -> fn first which the function then translates back. This gives a sizeable performance improvement since a significant number of lookups are avoided. (Bitbake rev: 3190cb83e2af195a464f669c5aa8aedbf795160e) Signed-off-by: Richard Purdie <>
2012-06-25bitbake: Fix for Hob bug #2323Cristian Iorga
Removed unnecessary button from Recipes screen and replaced the button that diplayed packages size and total image size from Packages screen with a label. (Bitbake rev: e6ff1d4bab43fdcd8af1230f1d54615f53c1978e) Signed-off-by: Cristian Iorga <> Signed-off-by: Richard Purdie <>
2012-06-25bitbake: use module tempfile to create temp fileKang Kai
I am sorry that use os.tmpname which casue a security warning. Follow Darren's suggestion to use tempfile.NamedTemporaryFile instead. (Bitbake rev: fe514a130579302312f68821536d108c8ceb4363) Signed-off-by: Kang Kai <> Signed-off-by: Richard Purdie <>
2012-06-25bitbake: fetch2: Ensure star character doesn't end up in mirror tarball namesRichard Purdie
If '*' does end up in mirror urls accidently, some strange things can break since supports_checksum() looks for this, ud.localpath can then get ignored and this can lead to empty directories being downloaded "successfully". '*' is a special case for file urls only at this point so remove any entries that accidentlly make it in through url mapping. (Bitbake rev: 1369bec2404d942acc3618a8d005ec6868dcfd41) Signed-off-by: Richard Purdie <>
2012-06-25bitbake: lib/bb/ remove unnecessary preserved variablesPaul Eggleton
_ and LANG no longer need to be preserved from the external environment. The value of _ changes between non-pseudo-wrapped and pseudo-wrapped invocations (e.g. between "bitbake -p" and "bitbake target") and this will currently trigger a full reparse in the absence of a whitelist entry in BB_HASHCONFIG_WHITELIST, which is not ideal. LANG used to be preserved in order to ensure the C locale was being used for tools invoked by bitbake, however we now set LC_ALL in bitbake.conf to take care of this. Second part of the fix for [YOCTO #2600]. Acked-by: Jason Wessel <> (Bitbake rev: 1c531dff2fb055ecab2d462027eecec3fabc2a44) Signed-off-by: Paul Eggleton <> Signed-off-by: Richard Purdie <>
2012-06-25bitbake: fetch2: Add new mirror syntax to simplify mirror specificationsRichard Purdie
When writing mirror specifications, the current regexp syntax can be awkward and hard to get it to do what you want. For example, extracting the 'basename' of a repository: PREMIRRORS = "git://.*/([^/]+/)*([^/]*) git://\\2;protocol=file" can now become: PREMIRRORS = "git://.*/.* git://;protocol=file" which is much clearer. A MIRRORNAME substitution is also added which contains an encoded form of both host and path. One of the problems with the existing regexp syntax is you couldn't access HOST information from PATH and vice-versa which is an issue this patch also addresses. Tests for the new syntax are also added. (Bitbake rev: c6b1acbad7b3d2698530eb8b5249adb4ab95da21) Signed-off-by: Richard Purdie <>
2012-06-25bitbake: fetch2: Handle errors orruring when building mirror urlsRichard Purdie
When we build the mirror urls, its possible an error will occur. If it does, it should just mean we don't attempt this mirror url. The current code actually aborts *all* the mirrors, not just the failed url. This patch catches and logs the exception allowing things to continue. (Bitbake rev: c35cbd1a1403865cf4f59ec88e1881669868103c) Signed-off-by: Richard Purdie <>
2012-06-25bitbake: process: Improve _logged_communicate bufferingRichard Purdie
There are two problems with the _logged_communicate that are both caused as a result of buffering I/O issues: 1) log truncation when python fails 2) While a bitbake task is running it is impossible to see what is going on if it is only writing a small incremental log that is smaller than the buffer, or you get only a partial log, up until the task exists. It is worse in the case that stderr and stdout are separate file handles, because previous code blocks on the read of stdout and then stderr, serially. The right approach is simply to use select() to determine if there is data available and also flush the log before exiting. This is based on a patch from Jason Wessel <> with some changes to flush upon exit, abstract the non blocking file descriptor setup and drop the buffer size parameter. (Bitbake rev: 361fb71e907aa84c28ecec79fefc6ca39c39172f) Signed-off-by: Richard Purdie <>
2012-06-25bitbake: Add support for rdepends task flagRichard Purdie
Currently its not possible to add arbitrary RDEPENDS to a specific task. This can be useful and this patch adds functionality equivalent to the 'depends' task flag. (Bitbake rev: db65080a6199baecc5c422294a4c4a9fd12dc29e) Signed-off-by: Richard Purdie <>
2012-06-25bitbake: Add function to set nonblocking operation on a file ↵Richard Purdie
descriptor (Bitbake rev: ab6d71ebfcfb7bedc064b25f84647c8815096e5a) Signed-off-by: Richard Purdie <>
2012-06-25bitbake: Remove -l option, its not necessaryRichard Purdie
If -l is specified and the source and destination are not on a common filesystem an error occurs. The -l option is however the default for git for local paths which the fetcher already now ensures in the file:// case. We can therefore safely drop the -l option. (Bitbake rev: 3aeb268b2aaab4bb8b1cfff1450e0b76aa8ce855) Signed-off-by: Richard Purdie <>
2012-06-25bitbake: lib/bb/ log when tainting the signature of a taskPaul Eggleton
Log a note when applying a taint to a task signature (e.g. when using the -f or -C command line options) so that the user knows this has been done. (Bitbake rev: 0fd960fdea83874eedb541cbc2920257e0f3fb81) Signed-off-by: Paul Eggleton <> Signed-off-by: Richard Purdie <>
2012-06-25bitbake: bitbake: tweak help text for -C slightlyPaul Eggleton
What is specified is a command (or "cmd" as in the help text for -f) rather than a task - i.e. you specify compile, not do_compile, so change the sentence to reflect that and reorder it slightly so it makes sense. (Bitbake rev: 9ab269410ef5cd4753fe11ec74759f421685bb7b) Signed-off-by: Paul Eggleton <> Signed-off-by: Richard Purdie <>
2012-06-21bitbake: fetch2/ Optimize clone fall back when it is localJason Wessel
A file:// url should use "clone -l" to greatly speed up the clone in the case of a kernel when it is local. (Bitbake rev: 2bab2cc3ffe67ee2a308074a6e4c2c7be5636d2f) Signed-off-by: Jason Wessel <> Signed-off-by: Richard Purdie <>
2012-06-21bitbake: ui/ use the new progressbar in HobKang Kai
[Yocto 2149] Use the new progressbar in Hob, so that we can reduce the maintenance burden of the multiple GUIs. (Bitbake rev: 6c0da26adbdcaa0c56737bacddb61678a9095e32) Signed-off-by: Kang Kai <> Signed-off-by: Richard Purdie <>
2012-06-21bitbake: fetch2: Update replace_uri to handle uri types explicitlyRichard Purdie
For mirror mapping, we never use regexps for the type component of the url. Doing so causes various slightly bizarre behaviour such as https:// urls being translated to files:// urls which we have no handler for. This patch forces the type matches to be direct, not regexp based and gives the expected bahvriour. (From Poky rev: 695d8aca0999d2d61970b990e83c3132ba6f12cb) (Bitbake rev: 604df1b25cf114e083f52917df2df64e01279c25) Signed-off-by: Richard Purdie <>
2012-06-21bitbake: test/fetch: Add a couple of extra test casesRichard Purdie
(From Poky rev: 01d8220ef8580ca980a14c05d500765ca2d37e2c) (Bitbake rev: 0d0a12fa0e4dabf01c1c24370aff54d26690a6dc) Signed-off-by: Richard Purdie <>
2012-06-21bitbake: test/fetch: Add in unit tests for uri_replace() and git premirrorsRichard Purdie
(From Poky rev: 4be81b5cadb7813d37152411c23764501f5869d3) (Bitbake rev: f91b4c2e3a2b3029d653a18de7ae2b0ecd7e2536) Signed-off-by: Richard Purdie <>
2012-06-21bitbake: fetch2: uri_replace() only consider ud.localpath where its a fileRichard Purdie
Using ud.localpath as a basename when it points at a directory causes problems. The supports_checksum() method gives a good indication of whether ud.localpath can be used in the way we need. (From Poky rev: 933ec8a44634e33f92f6f76de3a34094c3d63aa6) (Bitbake rev: dcd79ae20ab2c72c3312b2251c2b6dc4cabe988e) Signed-off-by: Richard Purdie <>
2012-06-21bitbake: fetch2: uri_replace() improve mirrortarball handlingRichard Purdie
We only consider mirror tarballs when the source and target urls are of differing types. We also should clear all url paramters when handling mirror tarballs. (From Poky rev: da140b8b0b3dda5429f9eee68829ef5247cdfe12) (Bitbake rev: 7619dcad29a6c2405b15a8fbadfa11e81b399ae1) Signed-off-by: Richard Purdie <>
2012-06-21bitbake: fetch2: uri_replace() remove what amounts to a null operation and ↵Richard Purdie
add some comments (From Poky rev: 6d67200d052ba72258f5a0a178542ef99500a9cc) (Bitbake rev: e67af4d12f390ce6083965509ca9ea85a76dc351) Signed-off-by: Richard Purdie <>
2012-06-21bitbake: fetch2: Add parameter handling to uri_replace()Richard Purdie
This means that parameters in the source expression are used as part of the match. Parameters in the destination are used explicitly in the final url. (From Poky rev: c465cb0c5c927dd41d96ad6d6fa1566349574bb7) (Bitbake rev: 3c468ac3ed6d045561afce19b85ae9dd18d87cea) Signed-off-by: Richard Purdie <>
2012-06-21bitbake: fetch2: Remove basestring test and simplify uri_replaceRichard Purdie
(From Poky rev: d5657883d34bfef6beec594ac8d799f617b6b3ad) (Bitbake rev: 84ffc261f376429b3a6b5d7bf2f6217cd10ca12a) Signed-off-by: Richard Purdie <>
2012-06-21bitbake: fetch2: Simplify some looping constructs in uri_replace()Richard Purdie
(From Poky rev: c6bd25150a842a530f958d7233b15ae50d42c6c8) (Bitbake rev: 075296f3e5e5e3662290a888a6ba11229a36b95a) Signed-off-by: Richard Purdie <>
2012-06-21bitbake: fetch2: Improve mirror looping to consider more casesRichard Purdie
Currently we only consider one pass through the mirror list. This doesn't catch cases where for example you might want to setup a mirror of a mirror and allow multiple redirection. There is no reason we can't support this and the patch loops through the list recursively now. As a safeguard, it will stop if any duplicate urls are found, hence avoiding circular dependency looping. (From Poky rev: 0ec0a4412865e54495c07beea1ced8355da58073) (Bitbake rev: e585730e931e6abdb15ba8a3849c5fd22845b891) Signed-off-by: Richard Purdie <>
2012-06-21bitbake: fetch2: Explicitly check for mirror tarballs in mirror handling codeRichard Purdie
With support for things like git:// -> git:// urls, we need to be more explicity about the mirrortarball check since we need to fall through to the following code in other cases. (From Poky rev: 28e858cd6f7509468ef3e527a86820b9e06044db) (Bitbake rev: a2459f5ca2f517964287f9a7c666a6856434e631) Signed-off-by: Richard Purdie <>