aboutsummaryrefslogtreecommitdiffstats
path: root/meta-iotqa
AgeCommit message (Collapse)Author
2017-08-23meta-iotqa: add qa basic tests for mraa-i2cnvelux
Add QA test for mraa i2c command line. Tests include version, bus detection of slave and list of slave buses. Signed-off-by: nvelux <nagarajagopalx.velu@intel.com>
2017-08-16refkit: combine multiple PRs in one mergeMikko Ylinen
This merge combines PRs: #289, #279, #276, #275, #273, and #254.
2017-08-16runtime/mraa-gpio: add qa tests for mraa-gpio.Ashwin Soman
Make changes to test mraa-gpio command line commands Signed-off-by: Ashwin Soman <ashwinx.soman@intel.com>
2017-08-16add qa tests for vaapi.Ashwin Soman
Make changes to test vaapi installed Signed-off-by: Ashwin Soman <ashwinx.soman@intel.com>
2017-08-14runtime/opencl: add QA tests for OpenCLYeoh Ee Peng
Add QA test to check for OpenCL ICD and library files. Also test to check OpenCL executable can run without any issue. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2017-07-23runtime/opencv: add comments to opencv test suiteYeoh Ee Peng
Add comments to the main test suite and each test cases. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2017-07-20refkit: Merge multiple PRs in onePatrick Ohly
This merges PR #241, PR #244, PR #245, PR #246, PR #251. Signed-off-by: Patrick Ohly <patrick.ohly@intel.com>
2017-07-20meta-iotqa: modify wifi test to retry incase of errorChristian da Costa
Daft test for testing wifi connection sometimes randomly fails. This fix forces the wifi test to retry 2 times before failing. Signed-off-by: Christian da Costa <christian.da.costa@intel.com>
2017-07-18runtime/opencv: add qa tests for opencv.Yeoh Ee Peng
Add tests for opencv python interface. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2017-07-05meta-iotqa: Mask out single node Bluetooth tests on MinnowBoard TurbotJair Gonzalez
Mask Bluetooth tests on MinnowBoard Turbot as the hci0 interface stops responding when Bluetooth is disabled on the current CI configuration: Expansion board: Silverjaw Lure (SKU 1000) Wireless adapter: Intel Dual Band Wireless-AC 7260 - 7260HMW YOCTO #11714 Signed-off-by: Jair Gonzalez <jair.de.jesus.gonzalez.plascencia@linux.intel.com>
2017-07-05meta-iotqa: Mask out single node Bluetooth tests on QEMUJair Gonzalez
Bluetooth tests can not be executed on QEMU, so add single node tests to its mask file. Signed-off-by: Jair Gonzalez <jair.de.jesus.gonzalez.plascencia@linux.intel.com>
2017-07-05meta-iotqa: Disable Bluetooth after Bluetooth testingJair Gonzalez
Disable Bluetooth after completing Bluetooth testing in order to not interfere with other tests. Signed-off-by: Jair Gonzalez <jair.de.jesus.gonzalez.plascencia@linux.intel.com>
2017-07-05meta-iotqa: Enable single-node Bluetooth testsJair Gonzalez
Signed-off-by: Jair Gonzalez <jair.de.jesus.gonzalez.plascencia@linux.intel.com>
2017-07-05meta-iotqa: Clean up Bluetooth test classesJair Gonzalez
Remove not used tags and update comments and variable names for added clarity. Signed-off-by: Jair Gonzalez <jair.de.jesus.gonzalez.plascencia@linux.intel.com>
2017-06-30Merge pull request #214 from klihub/flatpak-fixesMikko Ylinen
flatpak-enable the stock gateway image
2017-06-30meta-refkit-gateway: flatpak-enable the stock gateway image.Krisztian Litkey
Enable the flatpak image feature in the stock gateway image whenever the corresponding distro feature is enabled (which it is by default). Signed-off-by: Krisztian Litkey <krisztian.litkey@intel.com>
2017-06-29computervision.manifest: add gstreamer to testYeoh Ee Peng
Add gstreamer_cli.py to the computervision tests. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2017-06-29runtime/gstreamer_cli: add qa tests for gstreamer commandlineYeoh Ee Peng
Add tests for gst-inspect-1.0 and gst-launch-1.0. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2017-06-27tests: added a test for OpenCV DNN module.Ismo Puustinen
Signed-off-by: Ismo Puustinen <ismo.puustinen@intel.com>
2017-06-27Merge multiple PRsMikko Ylinen
This merge combines #198, #199, #204, #205, and #207.
2017-06-26refkit images: move "sensors" out of common into gatewayPatrick Ohly
The "sensors" image feature includes mraa, upm and via their dependencies also NodeJS. This is not required by all profiles and having it in common has some downsides: - slower build times in all tests using refkit-image-common (but not much, at least when NodeJS is already built, only 17s less when building twice, which takes several minutes) - dependency on components which are not in OE-core and thus have a higher chance of breaking in other distros Tests needs to be moved from common to gateway, too. While at it, sorting order gets restored in the gateway test list. Signed-off-by: Patrick Ohly <patrick.ohly@intel.com>
2017-06-22meta-iotqa: added minimal flatpak-session sanity test.Krisztian Litkey
Signed-off-by: Krisztian Litkey <krisztian.litkey@intel.com>
2017-06-22meta-iotqa: added minimal flatpak sanity test.Krisztian Litkey
Signed-off-by: Krisztian Litkey <krisztian.litkey@intel.com>
2017-06-21meta-iotqa: add ROS helloworld test caseDmitry Rozhkov
Signed-off-by: Dmitry Rozhkov <dmitry.rozhkov@linux.intel.com>
2017-06-21meta-iotqa: move refkit-ros-tests from meta-refkit-extraDmitry Rozhkov
Signed-off-by: Dmitry Rozhkov <dmitry.rozhkov@linux.intel.com>
2017-06-17Combine multiple PRs in oneMikko Ylinen
This combined merge takes PRs #109, #113, and #188.
2017-06-16meta-iotqa: make python tests compatible with python3Dmitry Rozhkov
Signed-off-by: Dmitry Rozhkov <dmitry.rozhkov@linux.intel.com>
2017-06-16meta-iotqa: convert firewall handling to nftables.Ismo Puustinen
Signed-off-by: Ismo Puustinen <ismo.puustinen@intel.com>
2017-06-16meta-iotqa: Disable nftables test with QEMUSimo Kuusela
It doesn't work with the way QEMU is tested so disable it. Signed-off-by: Simo Kuusela <simo.kuusela@intel.com>
2017-06-16meta-iotqa: Enable nftables testSimo Kuusela
Signed-off-by: Simo Kuusela <simo.kuusela@intel.com>
2017-06-16meta-iotqa: Add nftables testSimo Kuusela
Test dropping, rejecting and prerouting SSH with nftables. Signed-off-by: Simo Kuusela <simo.kuusela@intel.com>
2017-06-14Merge multiple changes in oneMikko Ylinen
This merge takes two existing PRs (#161 and #172) plus adds oe-core and bitbake submodule updates (with the fixes they expect).
2017-06-14selftest: move to OEQA framework v2Mikko Ylinen
The v2 of OEQA framework expects a few changes in selftests. The following modifications are made: * moved the files to <layer>/lib/oeqa/selftest/cases/ * updated class imports with (we're not using decorators): sed -i -e '/decorators/d; \ s/oeSelfTest/OESelftestTestCase/g; \ s/selftest\.base/selftest\.case/; \ s/selftest\.sstate/selftest\.cases\.sstate/' * changed filenames with '-' in them to have '_' instead due to how python unittest loader sees (or does not) the files. * added modules using SetUpClass() to call their parent's SetUpClass() * changed self.log to self.logger Additionally, move refkit_license_check.py under meta-refkit-core and add licensecheck.py to its search path. Signed-off-by: Mikko Ylinen <mikko.ylinen@linux.intel.com>
2017-06-05iotivity/base.py: Added base iotivity test classHumberto Ibarra
Add an iotivity base class for runtime tests, also moved the setup and teardown funcionality of client.py to the base class. Since many iotivity setup methods are similar, other iotivity classes should use this base class too. Signed-off-by: Humberto Ibarra <humberto.ibarra.lopez@intel.com>
2017-06-05iotivity/client.py: Improved logic of testcasesHumberto Ibarra
Testcases were using an odd logic in some if statemtets. This fixes it by introducing a simpler and more straightforward approach. Signed-off-by: Humberto Ibarra <humberto.ibarra.lopez@intel.com>
2017-06-05iotivity.py: Improved naming of module and testsHumberto Ibarra
Changes the names of the iotivity.py test module and its tests for names that are more clear and make more sense. Removed the "iotivity" or "iotvt" part from the names when it felt like it was too redundant. Also removed comments with little use. Signed-off-by: Humberto Ibarra <humberto.ibarra.lopez@intel.com>
2017-06-05wifi_connect.py: Fixed typos and pathsHumberto Ibarra
Previous reorganization introduced problems with paths in meta-iotqa. This fixes this path problem for wifi_connect and also a few typos. Signed-off-by: Humberto Ibarra <humberto.ibarra.lopez@intel.com> Signed-off-by: humberto <ibarra.jhumberto@gmail.com>
2017-06-05iotvt_wifi.py : Fixed path issues on import and configHumberto Ibarra
After some recent changes in reorganization, bugs in the paths were introduced in iotvt_wifi.py file. This fixes these path issues. Signed-off-by: Humberto Ibarra <humberto.ibarra.lopez@intel.com>
2017-06-05meta-iotqa/lib/oeqa/runtime: Removed tag decorators from testcasesHumberto Ibarra
Remove the tag decorators that were used previously in ostro since currently there is no use for them. Signed-off-by: Humberto Ibarra <humberto.ibarra.lopez@intel.com>
2017-06-05meta-iotqa: Removed unused soletta filesHumberto Ibarra
Soletta is not part of any refkit profile and is not tested at this moment. Removing soletta files and case_interface.py which is only used by soletta tests. Signed-off-by: Humberto Ibarra <humberto.ibarra.lopez@intel.com>
2017-05-31selftests: check if runtime licensing of an image is valid.Ismo Puustinen
The refkit-license-check.py selftest is intended for finding out if there are licensing conflicts in the images or if prohibited licenses are used in installed components. It uses licensecheck library from meta-refkit. Currently one test is implemented. The test tries to find out whether or not there are software components used under (L)GPLv3 license in refkit-image-computervision production configuration. Note that the test is not accurate and complex enough to be used as a guarantee that the image licensing is valid and it doesn't contain any (L)GPLv3 components. It is just a tool helping to catch some possible mistakes. Signed-off-by: Ismo Puustinen <ismo.puustinen@intel.com>
2017-05-17meta-iotqa: Remove alsa error msg from whitelistOlev Kartau
"file /var/lib/alsa/asound.state lock error" has not occured in 500 most recent CI PR jobs Signed-off-by: Olev Kartau <olev.kartau@intel.com>
2017-05-17meta-iotqa: add another dp_aux_ch error msg to whitelistOlev Kartau
Message "*ERROR* dp_aux_ch not done status 0xa1450064" is randomly present in few percent of test runs. Signed-off-by: Olev Kartau <olev.kartau@intel.com>
2017-05-17Merge several PRs in oneMikko Ylinen
This consolidated merge pulls #149, #151, #153, and #155 PRs in one branch.
2017-05-16meta-iotqa: Reorganized test modulesHumberto Ibarra
Reorganize test modules in a way that makes more sense. Tests are now classified by component. Also, remove unneeded 'comm' prefix in some modules. Update paths to modules in manifests. Also, sanity tests are better grouped as part of manifest than module location, so moved sanity test modules to proper location. Signed-off-by: Humberto Ibarra <humberto.ibarra.lopez@intel.com>
2017-05-16meta-iotqa/README.md: Small improvements to guideSimo Kuusela
Signed-off-by: Simo Kuusela <simo.kuusela@intel.com>
2017-05-16meta-iotqa/README.md: Cosmetic improvementSimo Kuusela
Signed-off-by: Simo Kuusela <simo.kuusela@intel.com>
2017-05-16test-iot.bbclass: Pack testsuite with specific dir nameSimo Kuusela
Depending on if "do_test_iot_export" task is done with or without docker the directory name inside testsuite tarball will differ. So just use specific name with it ("iottest"). Signed-off-by: Simo Kuusela <simo.kuusela@intel.com>
2017-04-26Enable QEMU testingSimo Kuusela
For QEMU testing qemu.mask file has been created that includes all tests that can't be run on QEMU. Also if-else structure has been added to tester-exec.sh so tests on real devices are run using DAFT and QEMU tests are run with some bash and expect script. The expect script is used to run the QEMU and add an SSH key to it so tests can be run. Signed-off-by: Simo Kuusela <simo.kuusela@intel.com>
2017-04-18meta-iotqa: test_iot_export: drop ${PN} dependencyMikko Ylinen
With the removal of do_build task of all -initial recipes in OE-Core, a missing dependency error was triggered when exporting the iot test suites. The ${PN}:do_build for an image recipe further had a dependency to all do_build tasks. Fix the dependency setting with a proper 'after' dependency instead of directly depending on '${PN}:do_build'. Also, we need to ensure test_iot_export has the test tools correctly deployed so that test_iot_export can pack them up. Signed-off-by: Mikko Ylinen <mikko.ylinen@linux.intel.com>