summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2018-02-15toaster: do not fail on optional 'custom.xml' filedreyna/toaster/custom_fixture_12554David Reyna
Explicitly capture and ignore errors when trying to load the optional 'custom.xml' fixture file. [YOCTO #12554] Signed-off-by: David Reyna <David.Reyna@windriver.com>
2018-02-14bitbake: bitbake-user-manual: Added google-repo fetcher and REPODIR var.Nicolas Cornu
Added a new repo Fetcher section in the same spirit as the existing sections for other supported fetchers. Changes included the new section, removal of the bulleted item that mentioned this fetcher as an "additional" fetcher, and the creation of a new variable in the glossary named REPODIR. (Bitbake rev: 1cf084cee506574b7bb6ed03344597b3b2f2fe08) Signed-off-by: Nicolas Cornu <nicolac76@yahoo.fr> Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14bitbake: bitbake: toaster: don't use git fetch --allRobert Yang
The '--all'' fetches all remotes, including the ones in $HOME/.gitconfig, which causes the fetching very slow, so don't use "--all", git fetch should be enough. (Bitbake rev: 038a5f4b767df7944e73b2e859ac3af2d3a08bf1) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14bitbake: fetch2: Handle missing donestamp file when content is validNathan Rossi
In order to allow users to manually populate the download directory with valid content change the assumption that missing the donestamp file means unfetched content. This allows users to populate the download dir without needing to create dummy .done files such that a user does not need a PREMIRROR when using BB_NO_NETWORK to provide valid content files in the download directory. To ensure the correct result this change also fails first if the localpath does not exist. This prevents further parts of the function attempting to calculating the checksum on non-existent files. This also fixes some edge conditions around where if the donestamp exists but the localpath does not it returns, and did not remove the donestamp. Also added test cases to cover this use case and additional use cases where for example the fetcher does not support checksums. (Bitbake rev: a335dbbb65d5b56e71d98cf3e4fa9bfbec1dcde6) Signed-off-by: Nathan Rossi <nathan@nathanrossi.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14bitbake: fetch2/npm.py: Fix inverted condition to prevent infinite loopBöszörményi Zoltán
At least the cli-color node module has dependencies that have cyclic dependency among themselves. npm.py is prepared to deal with such a case but the condition is handled only for downloading or not a dependency again, but then it goes checking the its dependency which causes an infinite loop in _getdependencies(). Make this function simply return when a dependency is already downloaded and only download and check its dependencies when not. (Bitbake rev: 545540420112992e53f4a83104af10452df168d0) Signed-off-by: Zoltán Böszörményi <zboszor@pr.hu> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14bitbake: contrib/dump_cache.py: make it can dump everythingRobert Yang
Have a simple tool to dump bb_cache.dat is useful for investigating and studying bitbake cache. The old contrib/dump_cache.py can dump pn, pv and packages for it, now enhance it dump everything. Here is the usage: $ /path/to/dump_cache.py --help usage: dump_cache.py [-h] [-r RECIPE] [-m MEMBERS] [-s] cachefile bb_cache.dat's dumper positional arguments: cachefile specify bb_cache.dat optional arguments: -h, --help show this help message and exit -r RECIPE, --recipe RECIPE specify the recipe, default: all recipes -m MEMBERS, --members MEMBERS specify the member, use comma as separator for multiple ones, default: all members -s, --skip skip skipped recipes Use dump_cache.py --help to get help (Bitbake rev: 104572438dfedf6025fbfd125aef1d56134012e7) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14bitbake: bitbake: parse: fixes for resolve_file()Robert Yang
The resolve_file() calls mark_dependency(), so the one which calls resolve_file() doesn't need call mark_dependency() again. (Bitbake rev: 4682571107323a39b42cd9ec8ee67419e7f15acc) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14bitbake: bitbake: cache: improve debug messageRobert Yang
* Print message when cachefile is found/not can help debug. * Update "Using cache in" to "Cache dir:" since it was the same as the debug message of "codeparser & file checksum caches", which caused confusion. And whether the cache file will be used or not is still unknown at that time, so just print the cache dir. (Bitbake rev: c8d3a2016f432e8ed9e99d9c28850149ab6fd6d8) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14bitbake: bitbake: cooker: don't stop file notifier when cooker is shutdownRobert Yang
It should be live/exited with server rather than cooker, fixed: $ bitbake --server-only -T -1 Set MACHINE = "qemux86" in conf/local.conf $ bitbake quilt Set MACHINE = "qemuppc" in conf/local.conf $ bitbake quilt [snip] ERROR: When reparsing /workspace1/lyang1/poky/meta/recipes-connectivity/openssl/openssl_1.0.2m.bb.do_package, the basehash value changed from c216f7f4fdd3cf4a0b10b975a636426c to d5a8e9431ab261381752d7a64c7b2fa9. The metadata is not deterministic and this needs to be fixed. [snip] This is because the server doesn't know local.conf is changed since the notifiers are stopped, so it doesn't reparse, and then we would get the errors, let the notifiers live/exited with server can fix the problem. (Bitbake rev: a6a641cb9c5f3abe901b150da915372e295383d7) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14bitbake: bitbake: cooker: fix for BBFILE_PATTERN matches bbappendRobert Yang
The old code couldn't handle nestled layers correctly, e.g.: parent_layer/sub_layer/foo.bb Note there are two layers, parent_layer and sub_layer. And in parent_layer/conf/layer.conf: BBFILE_PATTERN_parent_layer = ""^${LAYERDIR}/" This setting is incorrect since it also matches parent_layer/sub_layer/foo.bb, so it warns that no files matched sub_layer, this is the expected behavior, but it doesn't warn when there is a parent_layer/sub_layer/bar.bbappend, this was incorrect since the bbappend is also matched by BBFILE_PATTERN_parent_layer, it should warn and let the user fix the problem. Check the bbappend in already "matched set" before return it as matched by "unmatched set" can fix the problem. (Bitbake rev: ec90245d28e52ea718d2ce084eb304cdc4355c9c) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14bitbake: bitbake: cooker: skip when BBFILE_PATTERN is emptyRobert Yang
There is nothing to do when BBFILE_PATTERN is empty. (Bitbake rev: b7da31641c24c53d47ea45a7119d1bd353011b39) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14bitbake: fetch/git: Use 'git-make-shallow' from bin directoryNathan Rossi
Move the code that existed in tests/fetch.py for determining the path to 'git-make-shallow' into the git module and reference it. This ensures that 'git-make-shallow' is always available and the desired version regardless of the path variable or whether git exposes the command. (Bitbake rev: 6b508ab8fd5aa796c1c00c970e81e5e93f84d35d) Signed-off-by: Nathan Rossi <nathan@nathanrossi.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14bitbake: main/runqueue: Rework runall task and add runonly optionRichard Purdie
The runall commandline option was confusing people. There are in fact two different behaviours people may want. a) For a given target (or set of targets) look through the task graph and run task X only if its present and would have been built. b) For a given target (or set of targets) look through the task graph and run task X if any recipe in the taskgraph has such a target even if it wasn't in the original task graph. I've decided to interpret the existing "runall" option as b), even if right now if behaves like a). For a), which is a valid use case, this patch adds a "runonly" option. With both behaviours present, I'm hoping we can then kill off the "fetchall", "checkuriall" and other tasks from OE metadata and replace them with this option. This would significantly speed up task graph processing. (Deleting the checkuriall and fetchall tasks takes "bitbake core-image-sato -g" from 22s to 8s). (Bitbake rev: 546a662c877b2d3af35e3996950582ed2df41fe4) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14dev-manual: Fixed variable link to DEFAULTTUNE variableKristi Rifenbark
Fixed [YOCTO #12458] (From yocto-docs rev: 161d7ec7c81db93120af11b07162b36785614302) Signed-off-by: Kristi Rifenbark <kristi@buzzcollectivemarketing.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14ref-manual: Added 16.04 as the LTS for UbuntuKristi Rifenbark
Fixed [YOCTO #12537] (From yocto-docs rev: 20a80210eeefddff91a6ea669a63c417144a529c) Signed-off-by: Kristi Rifenbark <kristi@buzzcollectivemarketing.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14getting-started, dev-manual: Created Layer Model sectionScott Rifenbark
This involved removing the general information about layers from the dev-manual and incorporating it into the new section of the getting-started manual. (From yocto-docs rev: 26438b03751948661f48fb0c023e393101b80e19) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14getting-started, mega-manual: New content for intro chapterScott Rifenbark
Created content for "What is the Yocto Project" section. Involved a new figure that had to be shared in the mega-manual figures folder. (From yocto-docs rev: 72c18abd11587f4d78848afb8a71ff7f4a0e76d0) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14getting-started, mega-manual: Added new GS chapterScott Rifenbark
I have added a chapter to the getting-started manual that will introduce the YP. Just the framework exists at this point. Changes to the mega-manual.xml file were made to include the new chapter in that manual as well. (From yocto-docs rev: 8a52156ac02d9a9a97c5f0cd8dce5f70d2be68d0) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14getting-started: Chapter title changeScott Rifenbark
Updated the manual introduction chapter's title. (From yocto-docs rev: db067668a6202318bbbcc62cc455c34e099182de) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14ref-manual: Removed Ubuntu 14.04 from Supported Linux DistributionKristi Rifenbark
Fixes [YOCTO #12537] (From yocto-docs rev: 1bfa46614a93320c44ddc31fa8866e82c5349293) Signed-off-by: Kristi Rifenbark <kristi@buzzcollectivemarketing.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14documentation: Moved the detailed build section to concepts-manual.Scott Rifenbark
The section that provides a closer look into the build system has moved from the getting-started manaul to the concepts-manual. I fixed all the links, provided some coded formatting of the entire section, and made general updates. The other manuals had links that needed fixed due to the move. (From yocto-docs rev: b83a5619f56ebd9879fdcadcf474859e68b26d58) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14Makefile: Updated tarball lists for figuresScott Rifenbark
The list of *.png files included in the TARBALL variable setting changed due to figures moving from the getting-started manual to the concepts-manual. (From yocto-docs rev: 1439fa9f22a2b2746aa8e8303205f5ec33c7f67b) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14getting-started: Removed unused figuresScott Rifenbark
The figures from the deeper look of the build section got moved to the concepts manual. Removed these unused figures. (From yocto-docs rev: 13175a89b6d7bf79a86f4ac45d5f2cd78ba02108) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: Added figures for closer look sectionScott Rifenbark
Had to move these figures from the getting-started manual to the concpets manual. (From yocto-docs rev: ba221db465a7535197d9e29f5136ef2d3a6e3171) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14dev-manual, getting-started: Moved the BB syntax sectionScott Rifenbark
This section on BitBake syntax appeared in the Getting Started manual. I decided that it should live with the section on writing a new recipe. (From yocto-docs rev: 8d83ce3e11405b2f12f27cdd117a19c4af52146a) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: Updated the introduction text.Scott Rifenbark
(From yocto-docs rev: f8ee4c23b46bb02cf82d26ed6c1849cae0cad51f) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: General editsScott Rifenbark
Removed redundant links, changed some wordings. This was a general scrub of the prose. (From yocto-docs rev: 2c0ff0af7df3aa46fc05aaf28039a2ffb380424a) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: Updated toolchain fig to use "*_ext"Scott Rifenbark
(From yocto-docs rev: 64f3edd786779a1c1a7da8a5005c653a4ff8ce2a) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14ref-manual: Updated "Build System" term to "Build Host"Scott Rifenbark
(From yocto-docs rev: 2f5b8678e3c4b791a8cdfe5e75da706b97fbc753) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: Updated toolchain figure to use "*_extScott Rifenbark
(From yocto-docs rev: 88bf1a438f7a7323f1b7275d3d7bf715d4973569) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14ref-manual: Updated comprehensive list of manuals etc.Scott Rifenbark
I added the concepts manual, the ref manual, and the mega- manual to the list. (From yocto-docs rev: 180387ac9ae74cd5b69c4cf6338b72daef4b9f37) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: Content adjustments for the manual.Scott Rifenbark
The manual's two files are an introductory chapter and then a deeper concepts chapter. I scrubbed through the material, which originated from the getting-started (overview-manual). (From yocto-docs rev: 2ca572fac3ca71e73aad9bdd516a6ce90b148c53) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14Makefile: Updates so that the new concepts-manual can be made.Scott Rifenbark
(From yocto-docs rev: ede784df8034d3e582248952716af3441315cae9) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14documentation: Updated links into new concepts-manualScott Rifenbark
Creation of a new concepts manual and moving of chapters from the getting-started (overview-manual) caused many links and manual reference titles to break. I fixed these throughout the YP docs. (From yocto-docs rev: 30f2bc46be4a0faf5302eb8605bcb29f3bee6cf3) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: Updates to parent fileScott Rifenbark
Edits to create the main file that builds the concepts-manual. Includes the chapters that comprise the book. (From yocto-docs rev: d3a82e7cf50d77fcc4a37f13be98a61d85b1e527) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: Updated customization files to point to style guide.Scott Rifenbark
(From yocto-docs rev: d0b35e9fa0240466dc4d5436e3a12ba87114951e) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: Updated style sheet to display title PNG file.Scott Rifenbark
(From yocto-docs rev: 90eab7064d1fca0d37fd49db163d792880be5a1b) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14mega-manual: Added concepts-manual so it can be madeScott Rifenbark
Also updated the mega-manual.sed file with two lines to process links in the concepts-manual. (From yocto-docs rev: 622ce2fc82cbf92351aa2000c3d92bbabafc1d24) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual, mega-manual: Added title fig for concepts-manual.Scott Rifenbark
(From yocto-docs rev: c932704d29bd0a065a28675859d5b6f09d8e87e5) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: Removed unwanted figuresScott Rifenbark
When creating the new concepts-manual, I copied the existing getting-started manual over. This created a figures folder that had a lot of figures not needed in the concepts-manual. They have been removed. (From yocto-docs rev: 24bd39c7f3967a1e8fbac7a8ab44360c25a9bec1) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: Removed redundant chapterScott Rifenbark
This chapter appears in the getting-started manual. (From yocto-docs rev: 3f4c2fc211189e59e45bef6b379dc1f6ebfb7391) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14concepts-manual: Added new manual treeScott Rifenbark
Tree added only. (From yocto-docs rev: bacfd8c9103489c9b5a3459855d0804531ef3a75) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14documentation: Purged overview manual referencesScott Rifenbark
When I converted the Yocto Project Overview Manual to the Getting Started With Yocto Project Manual, I updated the strings for references from "&YOCTO_DOCS_OVERVIEW_URL" TO "&YOCTO_DOCS_GS_URL". Unfortunately, I did it with a global command that did not take into account the text the might follow the link by saying "see such-and-such section in the Yocto Project Overview Manual." So, I had to hand fix these. Additionally, since I have moved a deeper concepts chapter that was in the getting-started manual to a new Yocto Project Concepts chapter, many of those links changed had to really go to the new manual instead. Those were fixed. (From yocto-docs rev: fca1c56b0764802fb6a687ea81ab0fb95186cf0a) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14mega-manual.xml: Removed the getting-started-concepts.xml fileScott Rifenbark
Because the deeper concepts chapter that was in the Getting Started With Yocto Project Manual was moved to a new Yocto Project Concepts Manual, I had to delete it from the mega-manual.xml file where it would be included as a chapter in the getting-started manual. (From yocto-docs rev: a6847cc90cd0e35e275dd4cf080067ecbe5d4361) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14getting-started: Removed "concepts.xml" fileScott Rifenbark
This file was for a deeper concepts chapter. It will go into the new Yocto Project Concepts Manual. Removing it required deleting the *.xml file and updating getting-started.xml to not include it in the build. (From yocto-docs rev: 2df213c1cdba8f48918e8240de47c1758352807d) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14poky.ent: Added variable for "concepts-manual"Scott Rifenbark
New variable for links into the new "Yocto Project Concepts Manual". (From yocto-docs rev: 8a19b2b9d54cce664605993da068eed9537736a3) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14dev-manual, ref-manual: Updated references to Bugzilla wiki pageKristi Rifenbark
Fixes [YOCTO #12475] (From yocto-docs rev: 460660fda7433959cff13897ece4a6c9f7ff8d09) Signed-off-by: Kristi Rifenbark <kristi@buzzcollectivemarketing.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14ref-manual: Reformatted Note to use bulletsKristi Rifenbark
(From yocto-docs rev: 2aa21e54b620c147ea6db9dee206e40800d7d34c) Signed-off-by: Kristi Rifenbark <kristi@buzzcollectivemarketing.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14getting-started: Removed accidental tracked filesScott Rifenbark
I accidentally pushed a commit after building out the new getting-started manual before applying some key files to the .gitignore file. So, the HTML, TGZ, and eclipse/* stuff got tracked in Git. I don't want that. So I had to use the 'git rm' command to untrack those files. (From yocto-docs rev: 217f6db7f741cee266885a845b2b0e7faf96e537) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-14getting-started: Changed chapter idScott Rifenbark
(From yocto-docs rev: 52cc6ae12c5c92f6f8e508571b943443a6d133f1) Signed-off-by: Scott Rifenbark <srifenbark@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>