aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2019-01-30Modified ptest parser scriptHEADmasterSudhir Sharma
We have minor modidied ptest parser script to make it stable. Signed-off-by: Sudhir Sharma <sudhirx.sharma@intel.com> Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-12-14testopia/conf: add configurations for QA 2.6 thud meta-intel 10.0qa-2.6.rc2-meta-intel-10.0Yeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed for QA 2.6 thud meta-intel 10.0 testing. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-10-16script to automate converting testopia test case to predefined json outputYadav, PankajX
Adding script to automate converting manual testopia test case(s) to predefined json output
2018-10-12Adding script for analyzing testopia resultYadav, PankajX
This script is intend to analyse the testopia result of any particular release using selenium. This script will create a qa_graph excel sheet upon successful execution which will contain following information under that release: Total number of - auto test cases, manual test cases, passed test cases, failed test cases, idle test cases, running test cases, blocked test cases, paused test cases, error test cases
2018-09-25testopia/conf: updated to correct environment in filesangeeta.jain
testopia_execution_template_environment.config Merge branch 'master' of ssh://push.yoctoproject.org/qa-tools Signed-off-by: sangeeta.jain <sangeeta.jain@intel.com>
2018-09-25testopia/conf : Configuration file for QA 2.6 M3 rc1qa-2.7.m2.rc1qa-2.7.m1.rc1qa-2.6.m4.rc1qa-2.6.m3.rc1sangeeta.jain
Removed Meta-Yocto configuration Added Manua-BSP configuration and Manual OE-Core configuration Signed-off-by: sangeeta.jain <sangeeta.jain@intel.com>
2018-09-25Updated for 2.5.1.rc1 meta-intelsangeeta.jain
Signed-off-by: sangeeta.jain <sangeeta.jain@intel.com>
2018-07-27add initial ptest result comparison scriptYadav, PankajX
This script lists the degradation of the ptest results of the required 'package(s)' of the current release when compared with that of the previous release. Signed-off-by: Yadav, PankajX <pankajx.yadav@intel.com>
2018-07-19testopia/conf: update configurations for QA 2.6 M2 rc1qa-2.6.m2.rc1qa-2.5.1.rc1Yeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-07-12testopia/conf: add configurations for QA 2.6 meta-intel 10.0 M1qa-2.6.m2.rc1-meta-intel-10.0qa-2.6.m1.rc1-meta-intel-10.0qa-2.5.1.rc1-meta-intelYeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed for QA 2.6 meta-intel 10.0 M1 testing. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-06-28testopia/conf: update configurations for QA 2.6 M1 rc1qa-2.6.m1.rc1Yeoh Ee Peng
Update configurations that specified the testrun templates and each environments needed. Add configuration for ADT related to Meta_IDE testrun. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-06-19scripts/ptest-parser: overwrite individual ptest logYeoh Ee Peng
To prevent append ptest log on to same file after recursive execution of this script, replace append with write for file operation. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-06-19scripts/ptest-parser: extract ptest log by individual ptest packageYeoh Ee Peng
Extract the ptest log by individual ptest package and write to individual file to allow manual git diff to identify individual test that passed in previos release but failed in current release. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-06-18testopia/README: update with description for all actionsYeoh Ee Peng
Add description for all actions (closing_qa, setup_qa or execution_qa). Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-06-18testopia: add print status to track progress for setup and closingYeoh Ee Peng
Add print status to track progress of setup and closing actions. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-06-18testopia: add description for each supported actionsYeoh Ee Peng
Add description for all supported actions (closing_qa, setup_qa or execution_qa). Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-06-18testopia/conf: add configurations for QA 2.6 M1 rc1Ee Peng Yeoh
Add configurations that specified the testrun templates and each environments needed. Signed-off-by: Ee Peng Yeoh <eyeoh7@yctb05.ostc.intel.com>
2018-06-13compliance: remove unnecessary fs test to avoid false failingYeoh Ee Peng
Following advice from Anuj Mittal, remove the fs test to avoid random failure. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-05-31testopia/conf: add configurations for QA 2.2.4.rc1qa-2.2.4.rc1Yeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-05-24testopia/conf: add configurations for QA 2.3.4.rc1qa-2.3.4.rc1Yeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-05-24testopia/conf: add configurations for QA 2.4.3.rc2qa-2.4.3.rc2Yeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-05-17testopia/conf: add configurations for QA 2.5 M4 rc1 meta-intelqa-2.5.m4.rc1-meta-intelYeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed for meta-intel BSP 2.5 M4 sumo testing. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-04-24testopia/conf: add configurations for QA 2.5 M4 rc1qa-2.5.m4.rc1Yeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-04-23oeqatestcasechecker: add compare testcase from testopia to oeqaYeoh Ee Peng
Previous version only allow compare testcase from oeqa (baseline) to testopia to report missing oeqa testcase(s) inside testopia. This version add logic to compare the reverse, where it will compare testcase from testopia (baseline) to oeqa to report outdated testcase in testopia that no longer exist in oeqa. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-04-23oeqatestcasechecker: fix module library errorYeoh Ee Peng
Add the module library path to fix library error. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-04-23oeqatestcasechecker: check oeqa automated tests againts testopiaYeoh Ee Peng
Add script to check oeqa automated tests available inside oeqa test log file against the testcase(s) inside Testopia testrun specified. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-03-21testopia/conf: add configurations for QA 2.5 M3 rc1qa-2.5.m3.rc1Yeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-03-04testopia/conf: add configurations for QA 2.4.2.rc2 meta-intelqa-2.4.2.rc2-meta-intelYeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed for meta-intel BSP testing. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-02-21testopia/conf: add configurations for QA 2.5 M1 rc1 meta-intelqa-2.5.m1.rc1-meta-intelYeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed for meta-intel BSP testing. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-02-21testopia/conf: add configurations for QA 2.5 M2 rc1qa-2.5.m2.rc1Yeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-02-21testopia/conf: add configurations for QA 2.4.2.rc2qa-2.4.2.rc2Yeoh Ee Peng
Add configurations that specified the testrun templates and each environments needed. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-01-03testopia: remove .pyc files that are not neededYeoh Ee Peng
Remove those .pyc files that are not needed. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-01-03testopia: create testopia automation for closing/setup/executionYeoh Ee Peng
This testopia codes provide full testopia automation for closing activities where it automated the creation of testplan, checking testopia records before creation to avoid create of duplicate record, and seperate configuration data into various config files. Also include unittest codes for key modules. The main entry module is testopiastrategyrunner.py, execute --help to find out arguments needed. Example of running this full testopia automation: Closing Action: python testopiastrategyrunner.py -a closing_qa -st master -dt rocko -spv 2.4 -dpv 2.4 --verbose Setup Action: python testopiastrategyrunner.py -a setup_qa -st master -spv 2.4 -dpv 2.5 --verbose Execution Action: python testopiastrategyrunner.py -a execution_qa -st master -spv 2.5 -dpvm '2.5 M1' -drl rc1 -drv b73e96e7f3f5d1ba3a221d99792a7a3c7ef42c21 -dpd 2017-12-28 --verbose Look at README for more information. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2018-01-03performance: script used in performance testingYeoh Ee Peng
Add script and config used by performance testing. This script was called by the cron job setup inside GDC Fedora and Ubuntu performance machine. Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
2017-12-07testopia_update: Add rocko branchJose Perez Carranza
Add rocko branch as a supported branch by the script. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-11-15testopia_update/product: Correct issues when creating wiki by avoiding use ↵Jose Perez Carranza
plan_id Correct issues when creating a wiki due plan_id is set to None and this is causing failures t moment to do the query on Tstopia DB. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-11-07testopia_update: Fix clone templates processJose Perez Carranza
Fix an issue when cloning templates that requires an integer conversion and also an identetaion that cause problems on behavior of the script. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-10-20scripts: Correct ptest-parser to create wiki in proper formatJose Perez Carranza
Currently wiki is created correctly but format of tables is corrupted, hence a termination of table is deleted from every row and applied to the end of the table. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-10-06scripts: Add ptest-parser to create reports for pTest executionsJose Perez Carranza
Add ptest-parser.py scrip that creates a file with the report of pTest execution compared with the previous results provided, the data stored on the file is in wikimedia format to be copied and pasted on the new created wiki for pTest results of QA cycle. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-07-04utils/wikimaker: Add default valuesJose Perez Carranza
Add default values for section of “performance” and “pTest” to avoid use old data on new reports. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-07-04testopia_update: Add validation for empty sub parameters on setupJose Perez Carranza
Add an error message for the cases when “setup” is selected and no sub parameters are given. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-07-04scripts/full-test-cycle-wrapper: Add support for new 2.4 componentsJose Perez Carranza
Add support for new packages supported for 2.4 release and update components list according to release version. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-07-04poduct/init: Add support for PackageManagement componentJose Perez Carranza
Create package_management_issues.py product and add support to use this product on init file. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-06-12testopia_update: Add support to create_wiki functionalityJose Perez Carranza
Add option that allows using –create-wiki under setup option,this potion takes date and project as a parameter and search for tests runs and generates the wiki report data in a file. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-06-12testopia_update/utils: Add utils directoryJose Perez Carranza
Add utils directory to be used as the repository for different utilities -wikimaker.py : scripts that creates the wiki report data saves it to the data inside a file to be copied on the already created wiki page Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-06-12poduct/init: Add functions to get product and environment namesJose Perez Carranza
Add functions as follows: - get_test_plan_by_id : Get test plan providing the plan ID - get_product_name: Get product name providing the product ID - get_environment_by_id: Get environment providing the environment ID Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-06-12external/testopia: Modify commands to get Product and EnvironmentJose Perez Carranza
Modify commands to get Product and Environment name providing the ID. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-06-02testopia_update: Add functionality to list templatesJose Perez Carranza
Add support to list available templates per specific releases Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-05-29testopia_update.py: Add functionality for setup clone-templatesJose Perez Carranza
Add action “setup” to do a different actions on the exiting Testopia DB, also add validation for the specific option used on this new action, sub-option “-clone-templates” implemented to help on the setup for new release and cloning form the same bran or form one branch to another. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
2017-05-29init: Add functionality to clone templatesJose Perez Carranza
Add “clone_template” function that allow cloning in the same branch or for X to Y branch, also add “get_test_run_list” to do a query of test runs with specific summary and specific test plan. Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>