summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2017-10-16oeqa/selftest/cases/devtool: no need to pre-build xz-nativejoshuagl/alimon/oe_selftest_threadedJoshua Lock
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2017-10-16oeqa/selftest/cases: systemd_boot enable threaded runsAníbal Limón
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/context: Enable support for threaded runsAníbal Limón
Add an option to specify how many threads will be used for execution, default to 1. Add OE_SELFTEST_THREAD_NUM environment variable for be able to set thread num into the Yocto Autobuilder and don't need to figure out the version of oe-selftest script. If the thread_num are greater than 1 the OESelftestContextThreaded will be used, this is due to compatibility reasons. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16seltest/cases/devtool: Build dbus on test_devtool_add_git_localAníbal Limón
The dbus-wait recipe has the dependency of dbus, due to now we have build folder per test class the dependency needs to be build before run devtool add because without it the DEPENDS field is unset. The devtool/recipetool uses previously build recipes to figure out the dependencies. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16selftest/cases/devtool{,end}: Move update/finish_{upgrade,modify} tests to ↵Aníbal Limón
its own module This devtool tests are set to run at end because made changes into the poky repository causing problems (non deteministic meta data) in other execution threads. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2017-10-16oeqa/selftest/cases: Move devtool deploy test case to own moduleAníbal Limón
The devtool deploy test case uses runqemu that uses tinfoil so tinfoil requires to run on the main thread. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/cases: recipetool enable for threaded runsAníbal Limón
- Change to use wrappers from OESelfTestCase. - Move templayer dir creation to RecipetoolBase class because now every class has its own build folder. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2017-10-16oeqa/selftest/cases: devtool enable threaded runsAníbal Limón
- Add new class DevtoolCommon to split devtool suite into other modules. - Change to use wrappers from OESelfTest class (runCmd, bitbake). - When remove workspacedir using bitbake-layers use full path because now has it own builddir. - Add a build of xz-native because some tests needs it to decompress tarballs and is supposed to be provided, see bug [YOCTO #11474]. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2017-10-16oeqa/selftest/cases: eSDK enable threaded runsAníbal Limón
- Change some staticmethods to classmethods to be able access wrappers from OESelfTestCase. - Remove unused method update_configuration. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/cases: runtime enable threaded runsAníbal Limón
- Use wrappers from OESelfTestCase for runCmd, bitbake, etc. - Split into tree modules because runtime_test_export and runtime_test_postinsts uses runqemu/tinfoil and needs to be executed into the main thread. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2017-10-16oeqa/selftest/cases: runqemu enable threaded runsAníbal Limón
- Update to use wrappers {bitbake,get_bb_var} from OESelftestTestCase class. - Run into the main thread because it needs tinfoil to run. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/cases: imagefeatures enable threaded runsAníbal Limón
- Change to use wrapper methos from OESelfTestCase. - Move tests that use runqemu to its own module because it needs tinfoil and run in the main thread. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/cases: Use wrapper methods from OESelfTestCase class and ↵Aníbal Limón
enable threaded runs In order to support threaded runs in oe-selftest cases, there is a need to use wrapper methods that takes into account the current builddir by Test class. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/cases: Use builddir from class instead of get from environmentAníbal Limón
Now the build directory is setup by Test class, so the builddir attr points to the actual BUILDDIR instead of get from environment. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/cases: Use testlayer_path instead of call get_test_layer()Aníbal Limón
The testlayer_path is set at init of selftest so isn't need to call every time get_test_layer to get it. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/case: Support bitbake memres mode in per build directoryAníbal Limón
If BBSERVER is set on the environment the bitbake is set to be used as a memres, so starts an bitbake server per TestClass. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/case: tearDown extra commands print what actually failsAníbal Limón
Its better to have the output to see what actually fails in a command that is aim to execute at end of a test case. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/case: Creates meta-selftest layer per classAníbal Limón
The meta-selftest layer is used by test cases to modify meta data but in a threaded environment two test cases can modify the meta data causing errors because the signatures will change. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/case: Add wrappers to utils.commands modulesAníbal Limón
This wrappers are for be able to use a custom build directory per Test class, there is a function to modify the environment setting BUILDDIR, BBPATH and CWD. The oeqa.utils.commands module could be removed when other selftests (refkit, etc) are adapted to use this wrappers methods (get_bb_var{,s}, bitbake, runCmd). The remaining command (oeqa.utils) to provide a wrapper is runqemu, this has other issue because bitbake/tinfoil are expected to run into the main thread (signal handling, etc). Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/selftest/{case,context}: Add builddir by test class and contextAníbal Limón
The build directory by Test class will enable to use several instances of bitbake in parallel to enable oe-selftest threaded runs. [YOCTO #11429] Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/core/tests: Update test_loader threaded to cover main thread usageAníbal Limón
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/core/threaded: logSummary add skipped tests infoAníbal Limón
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/core/threaded: Add support to run into a thread at end of executionAníbal Limón
Some test cases aren't allowed to run into a multi-thread environment so add the posibility to run those tests at end of execution. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16oeqa/core/threaded: Enable support to use the main threadAníbal Limón
Some test cases needs to be executed by the main thread for several resons, this implmentation enables usage of the main thread to execute suites. The rules are if some test case request by test class attr _main_thread it will be executed, if no tests are scheduled to be executed into the main thread the algorithm with take the first suite in the pool, finallay this will avoid thread usage if only one suite needs to be executed. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-16bb/tinfoil: run_command handle busy status in bitbake serverAníbal Limón
When tinfoil request a command to bitbake is handled in async manner [1], sometimes is this ends on return a Busy status. This is a workaround a needs to be fixed in proper manner inside bitbake code. For example when running clientComplete and buildFile is on progress, ERROR: Function failed: base_do_unpack Traceback (most recent call last): File "/home/alimon/repos/poky/scripts/lib/devtool/standard.py", line 797, in modify initial_rev = _extract_source(srctree, args.keep_temp, args.branch, False, rd, tinfoil) File "/home/alimon/repos/poky/scripts/lib/devtool/standard.py", line 562, in _extract_source runtask(fn, 'unpack') File "/home/alimon/repos/poky/scripts/lib/devtool/standard.py", line 552, in runtask raise DevtoolError('Task do_%s failed' % task) devtool.DevtoolError: Task do_unpack failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/alimon/repos/poky/scripts/devtool", line 351, in <module> ret = main() File "/home/alimon/repos/poky/scripts/devtool", line 338, in main ret = args.func(args, config, basepath, workspace) File "/home/alimon/repos/poky/scripts/lib/devtool/standard.py", line 864, in modify tinfoil.shutdown() File "/home/alimon/repos/poky/bitbake/lib/bb/tinfoil.py", line 427, in shutdown self.run_command('clientComplete') File "/home/alimon/repos/poky/bitbake/lib/bb/tinfoil.py", line 320, in run_command raise TinfoilCommandFailed(result[1]) bb.tinfoil.TinfoilCommandFailed: Busy (buildFile in progress) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-10-10bitbake: toaster/highlight.pack.js: Fix corrupted fileRichard Purdie
The newly added file in the last commit was corrupted, fix it. (Bitbake rev: be393f247a08c0a4a50a6a76b8fd57f78295d2a1) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-10bitbake: toaster: Remove prettifyDavid Reyna
Remove "prettify.js" and "prettify.css" due to license issues with Apache2. Replace with "highlight.pack.js" with its BSD3 License. [YOCTO #12206] (Bitbake rev: 6361698819530382541506b06a61f2c76dde59cb) Signed-off-by: Jason Wessel <jason.wessel@windriver.com> Signed-off-by: Brian Avery <brian.avery@intel.com> Signed-off-by: David Reyna <david.reyna@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-09poky: add debian-9 to SANITY_TESTED_DISTROSMartin Kelly
I have been working with OE on debian-9 for several months now without issue. In addition, I tested a build + runqemu for core-image-sato following the quickstart guide and had no issues. (From meta-yocto rev: 2d8a572df7498ce8eb3a78f05384f0f7dd5ecb91) Signed-off-by: Martin Kelly <mkelly@xevo.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-09packagegroups: remove a bbappendSlater, Joseph
Force items into packagegroup-core-tools-profile? I don't think so. (From meta-yocto rev: df0f331832fad818604d8696700765fb4d3ba072) Signed-off-by: Joe Slater <jslater@windriver.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-09bitbake.conf: add tools required by testimage to HOSTTOOLS conditionallyChen Qi
Add tools required by testimage to HOSTTOOLS only when testimage is inherited. These tools, as described in the comment, are only required by the testimage task. So this change should not have negtive effect. This would also solve build error on hosts which miss some tool such as scp. (From OE-Core rev: 8ca61a5464743ff85b6d26886112750d6ddd13e0) Signed-off-by: Chen Qi <Qi.Chen@windriver.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-09gcc-6.3: Backport patch to fix ICE on ARMKhem Raj
Fixes internal compiler error: Max. number of generated reload insns per insn is achieved (90) (From OE-Core rev: d2631f45a057c53797b7ba657662f35f66a2b04e) Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-09e2fsprogs: modify ptest scriptJuro Bystricky
e2fsprog testsuite used to log results into its own log file into /usr/lib/e2fsprogs/ptest/test.log. Therefore console output was not available and redirecting ptest-runner output into a log file would not capture output of any individual tests. So overall the whole e2fsprogs testsuite consisting of about 300 tests was evaluated as a single test. This patch ensures the e2fsprogs test_script output is not automatically redirected while executing during run-ptest. Any redirection is up to the user. Additionally, the results of tests are prefixed by more canonical "PASS:" FAIL:" based on the actual test results. Aditionally, remove various files created by the testsuite. [YOCTO #12146] (From OE-Core rev: a218b85dba1a481901548f7414676c0ae6f43316) Signed-off-by: Juro Bystricky <juro.bystricky@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-09linux-firmware: Split i.MX SDMA firmwaresOtavio Salvador
This splits out the i.MX SDMA firmwares for i.MX6 and i.MX7 SoCs. This also includes the required runtime provides, conflicts and replaces for the old firmware-imx which was provided by NXP BSP layer. (From OE-Core rev: b3f3078fd4349fdf6986dd57e4b04bce03630924) Signed-off-by: Otavio Salvador <otavio@ossystems.com.br> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07bitbake: README: new readme file including main aspects of the projectLeonardo Sandoval
Includes brief description of the project, pointers to website, documentation, mailing list and source code. (Bitbake rev: 28249c42701f9156a0b3153d72d7e46dacab37cb) Signed-off-by: Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07bitbake: bitbake-user-manual-metadata: include a space on a append exampleLeonardo Sandoval
By definition, the override operator "_append" does not include a space, so include it. (Bitbake rev: 6775e2de9067d8f472d7bfb5b78ec835a5688755) Signed-off-by: Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07bitbake: bitbake-user-manual/bitbake-user-manual: remove YP as build systemLeonardo Sandoval
YP is not a build system, so it can not be used as build system example. (Bitbake rev: dc86d38816aeb0fcbceb34cbaaa6ed98d33383e9) Signed-off-by: Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07bitbake: Add args.force to localargs before do_add_layerJeremy A. Puhlman
Adding layer "meta-signing-key" to conf/bblayers.conf Traceback (most recent call last): File "/local/build/project/build/poky/bitbake/bin/bitbake-layers", line 103, in <module> ret = main() File "/local/build/project/build/poky/bitbake/bin/bitbake-layers", line 96, in main return args.func(args) File "/local/build/project/build/poky/bitbake/lib/bblayers/layerindex.py", line 250, in do_layerindex_fetch self.do_add_layer(localargs) File "/local/build/project/build/poky/bitbake/lib/bblayers/action.py", line 44, in do_add_layer if not (args.force or notadded): AttributeError: 'Namespace' object has no attribute 'force' (Bitbake rev: 4325f7a7df67eaf4b51af03b453e84bf88fae408) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07bitbake: bitbake-user-manual: add more gitsm fetcher limitationsMikko Ylinen
The submodule sources fetched by the gitsm fetcher are not automatically tracked by the licensing and archiver infrastructures. Add these limitations to the existing 'warnings' sections for gitsm. [YOCTO #11594] (Bitbake rev: ca10186d60a52af6464bd998fa0b7146513bed0e) Signed-off-by: Mikko Ylinen <mikko.ylinen@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07bitbake: toaster: build missing toaster.conf settingsDavid Reyna
The bitbake server changed such that the Toaster custom settings from 'toaster.conf' and 'toaster-bblayers.conf' that were set when the '--server-only' mode was started were lost when the subsequent build request happened, resulting in builds missing all custom changes. This patch asserts those environment settings in both server calls. [YOCTO #12194] (Bitbake rev: fa767d85f19a7af92a44fe11fdfb38633009ad71) Signed-off-by: David Reyna <David.Reyna@windriver.com> Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07bash-ptest: install additional localesJuro Bystricky
bash-ptest fails several tests. This patch fixes: FAIL: run-intl The test used to fail because of missing locales (fr_FR, de_DE) [YOCTO #12145] (From OE-Core rev: 70e544452b6825686f06484d994936ded677825f) Signed-off-by: Juro Bystricky <juro.bystricky@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07lib/oe/package_manager.py (rpm): Allow use of non-signed packagesOtavio Salvador
When we wish to use the package feed for local development, it does not uses GPG signed feeds by default but dnf uses package signature check. We need to configure the GPG signature check out so it works out of box. With this patch, installing non-signed packages works: $: dnf install <package> (From OE-Core rev: bceafe23cbe12a1ab0628b70865cb8867c7d7ee1) Signed-off-by: Otavio Salvador <otavio@ossystems.com.br> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07libxml2-ptest: set LC_ALL=en_US.UTF-8Juro Bystricky
We need to specify UTF-8 in the environment to avoid an error such as: UnicodeEncodeError: 'ascii' codec can't encode character '\xe4' (From OE-Core rev: d7f1fe6c8419b8c59e601c56245373d094cae298) Signed-off-by: Juro Bystricky <juro.bystricky@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07libxml2-ptest: support for encoding ISO-8859-5Juro Bystricky
This fixes the error: ./test/errors/759398.xml:1: parser error : Unsupported encoding ISO-8859-5 <?xml version='1.0' encoding='ISO-8859-5' standalone='no'?> ^ ./test/errors/759398.xml : failed to parse FAIL: Error cases stream regression tests (From OE-Core rev: 01257f43e024b49196cb756501b098193d1f6085) Signed-off-by: Juro Bystricky <juro.bystricky@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07libxml2-ptest: improve reproducibilityJuro Bystricky
Remove various build host references from libxml-ptest package. [YOCTO #11997] (From OE-Core rev: c2b53ec8d15b97da73353623c0cfe287f74992bf) Signed-off-by: Juro Bystricky <juro.bystricky@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07oe-pkgdata-util: add unescape option to read-valueRoss Burton
Some fields are multiline values which have been escaped, so add an option to unescape the \n and \t. (From OE-Core rev: 4165ec0057c6bbb24de681572034262351d9b34f) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07siteinfo: nios2-linux - remove wrong mutex infoJuro Bystricky
With the commit afa9f769d62034d4443dfe929422d1d591adf709 some nios2 builds (uboot, core-image-minimal, etc) were broken due to db trying to use ARM instructions in mutexes. The reason was db "configure" used the cached entry from nios2-linux (which was incorrect). So the remedy was to remove the incorrect cached entry and let db "configure" figure out which is the proper mutex to use. (From OE-Core rev: c17c6ba906425d4035b8e044c8bd8bd68c47ef74) Signed-off-by: Juro Bystricky <juro.bystricky@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07argp-standalone: drop RDEPENDS dev/staticdev packages on main packageMing Liu
This ensures argp-standalone-staticdev package could be installed correctly(without depending on the empty argp-standalone package) if it's being required during SDK population. (From OE-Core rev: 6d13c09fb57e13aa4aae590cd49cff7279c8685d) Signed-off-by: Ming Liu <liu.ming50@gmail.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07bitbake.conf: Add 'id' to HOSTTOOLSOtavio Salvador
The 'id' utility is used in 'rootfs_check_host_user_contaminated' rootfs-postcommand so it must be available. (From OE-Core rev: 6c054925d5f80790aea4cce6f8f83edc7da623b9) Signed-off-by: Otavio Salvador <otavio@ossystems.com.br> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07python-ptest: various fixesJuro Bystricky
python-ptest needs python-tests package installed in order to run any tests. This patch adds python-tests as a runtime dependency, so the test suite will be present in the image. While in there, also removed several build host references. [YOCTO #12144] (From OE-Core rev: ff83e15289e4b47cd3926220a0039bf97ec35120) Signed-off-by: Juro Bystricky <juro.bystricky@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-10-07utils.bbclass: Support applications with arguments in check_app_exist()Nikolay Merinov
check_app_exist function must support cases when "app" variable defined as "progname --args". For example BUILD_CC="gcc -march=x86-64" must pass sanity check. (From OE-Core rev: 5193ebca0ca8864404fc750def0e738417d104c7) Signed-off-by: Nikolay Merinov <n.merinov@inango-systems.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>