summaryrefslogtreecommitdiffstats
path: root/meta/recipes-devtools/python
AgeCommit message (Collapse)Author
2021-04-30python3: Improve logging, syntax and update deprecated modules to ↵Alejandro Enedino Hernandez Samaniego
create_manifest The imp module has een deprecated by upstream python, drop its usage (imp.get_tag) in favor of sys.implementation.cache_tag. Avoid incorrectly getting dependencies for running script and multiprocessing module. Improve logging behavior of the create_manifest task: - Use indentation. - Logs on temp directory. - Use a proper debug flag. - Standarize syntax. (From OE-Core rev: 003d73d74791e5d7dcdeb4f29fc7b05e35b345ea) Signed-off-by: Alejandro Enedino Hernandez Samaniego <alejandro@enedino.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit a3ac339f5b8549a050308ba94c4ef9093f10e303) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-04-30python3: Upgrade 3.9.2 -> 3.9.4Alejandro Enedino Hernandez Samaniego
- Rebased patch 0001-test_locale.py-correct-the-test-output-format Maintainer needs to sign CLA and resubmit - configure now explicitly requires autoconf-archive to be present (From OE-Core rev: 8c1473189f4439d2462130b3cface95dc251fe24) Signed-off-by: Alejandro Enedino Hernandez Samaniego <alejandro@enedino.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> (cherry picked from commit 34cb8f2a2ed36ad929dca9055c96f2f843656b8f) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-04-05python3: Skip failing ptests due to load variabilityYi Fan Yu
Skip tests until load issue is fixed, most commonly seen on the arm64 builder. [YOCTO #14296] (From OE-Core rev: 7c67bc2476b784083acbc7a55ecf3627ec8f2b6b) Signed-off-by: Yi Fan Yu <yifan.yu@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-23python3: fix PACKAGECONFIG handlingMartin Jansa
* it was changed from sysconf_dis to mods_disabled in: https://git.openembedded.org/openembedded-core/diff/meta/recipes-devtools/python/python3/0017-setup.py-do-not-report-missing-dependencies-for-disa.patch?id=7347556b18b45c5f9afc2cade565a75c95876914 but unfortunately this doesn't work as mods_disabled set by remove_configured_extensions can contain only extensions which were disabled, as this list: self.extensions: ['_struct', 'array', '_contextvars', 'math', 'cmath', 'time', '_datetime', '_zoneinfo', '_random', '_bisect', '_heapq', '_pickle', 'atexit', '_json', '_lsprof', 'unicodedata', '_opcode', '_asyncio', '_abc', '_queue', '_statistics', 'fcntl', 'pwd', 'grp', 'spwd', 'select', 'parser', 'mmap', 'syslog', '_xxsubinterpreters', 'audioop', '_csv', '_posixsubprocess', '_testcapi', '_testinternalcapi', '_testbuffer', '_testimportmultiple', '_testmultiphase', '_xxtestfuzz', '_curses', '_curses_panel', '_crypt', '_socket', '_ssl', '_hashlib', '_sha256', '_sha512', '_md5', '_sha1', '_blake2', '_sha3', '_sqlite3', 'termios', 'resource', 'ossaudiodev', 'nis', 'zlib', 'binascii', '_bz2', '_lzma', 'pyexpat', '_elementtree', '_multibytecodec', '_codecs_kr', '_codecs_jp', '_codecs_cn', '_codecs_tw', '_codecs_hk', '_codecs_iso2022', '_decimal', '_ctypes_test', '_posixshmem', '_multiprocessing', '_uuid', 'xxlimited', '_ctypes'] while PACKAGECONFIG in python3 usually uses this to disable _dbm, _gdbm or runtime modules. * without this change the do_install will fail (based on check_build_completeness.py log.do_compile) with: | ERROR: Execution of '/OE/build/oe-core/tmp-glibc/work/x86_64-linux/python3-native/3.9.0-r0/temp/run.do_install.69743' failed with exit code 1: | The necessary bits to build these optional modules were not found: | _dbm _gdbm readline (From OE-Core rev: fa5243693e35e1e0dc3247e2178f181051f68e77) Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-20python3: make pydoc rdepend on python3-ioBartosz Golaszewski
pydoc needs tempfile (provided by python3-io) to work. Add python3-io to its RDEPENDS. (From OE-Core rev: dfd1264ed6a2d7ff48a5286134bb80b1898fc0ba) Signed-off-by: Bartosz Golaszewski <bgolaszewski@baylibre.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-12python3-setuptools: Upgrade 54.1.0 -> 54.1.1Khem Raj
Changes [1] [1] https://github.com/pypa/setuptools/commit/d2ae3cd2cfc66c300bc6661ca33f0ba1f651fd56 (From OE-Core rev: 8e515c643f0197b78f6c7d597dfabcda71f4e898) Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-11python3-zipp: upgrade 3.4.0 -> 3.4.1Wang Mingyu
(From OE-Core rev: d34cc88cb72e8701b71a2a272daca2d755f66873) Signed-off-by: Wang Mingyu <wangmy@cn.fujitsu.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-11python3-pygments: upgrade 2.8.0 -> 2.8.1Wang Mingyu
(From OE-Core rev: 27da7a57b087536cd6cc8b9529f739fa7875a162) Signed-off-by: Wang Mingyu <wangmy@cn.fujitsu.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-11meta/recipes-devtools: Add HOMEPAGE / DESCRIPTIONDorinda Bassey
Added missing HOMEPAGE and DESCRIPTION found using the test command `oe-selftest -r distrodata.Distrodata.test_missing_homepg` [YOCTO #13471] (From OE-Core rev: 7290b773486da3888f848abf0dba747f2d9f42e1) Signed-off-by: Dorinda Bassey <dorindabassey@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-09python3-setuptools: update to 54.1.0Oleksandr Kravchuk
(From OE-Core rev: d0200689ba8373db188fa8d626efa84010eda457) Signed-off-by: Oleksandr Kravchuk <open.source@oleksandr-kravchuk.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-09python3-cython: Check for files before editingKhem Raj
If using debug-without-src policy then usr/src/debug won't exist, therefore the function will fail due to missing files, adding a check for files to exist before editing them fixes it. (From OE-Core rev: 0eb85a2670c9250350b66647f4cbdae446be830f) Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-06python3-jinja2: set CVE_PRODUCTChen Qi
Set CVE_PRODUCT for more accurate CVE scanning. (From OE-Core rev: aefcc7a7dd012530ed846292caaed70d20589a3a) Signed-off-by: Chen Qi <Qi.Chen@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-02python3-magic: upgrade 0.4.20 -> 0.4.22zhengruoqin
(From OE-Core rev: fabe66090d9046c66282b8e6152ae8fa0cfcad23) Signed-off-by: Zheng Ruoqin <zhengrq.fnst@cn.fujitsu.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-02python3-git: upgrade 3.1.13 -> 3.1.14zhengruoqin
(From OE-Core rev: efd9d653b76a8887643aa2361a25682039286579) Signed-off-by: Zheng Ruoqin <zhengrq.fnst@cn.fujitsu.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-02python3-cython: upgrade 0.29.21 -> 0.29.22zhengruoqin
(From OE-Core rev: 850624d39ff5a2fe35efa6719b4139c8f934d924) Signed-off-by: Zheng Ruoqin <zhengrq.fnst@cn.fujitsu.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-02python3-cython: Remove build paths from debug sourcesRichard Purdie
There are build paths which are in generated sources injected into ${PN}-src. These are in generated files and don't influence the binary output. As such we can correct them at do_package time by tweaking in an appropriately injected function. This fixes the reproducbility of the recipe. (From OE-Core rev: cc1de818247c9ae329fdc0536658b3968a4caea2) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-26meta/recipes-devtools: Add HOMEPAGE / DESCRIPTIONDorinda
Added HOMEPAGE and DESCRIPTION for recipes with missing decriptions or homepage [YOCTO #13471] (From OE-Core rev: bb05814335e7101bfd8df0a11dc18a044e867bed) Signed-off-by: Dorinda Bassey <dorindabassey@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-23python3: Fix python interpreter line length for nativesdkMingli Yu
Make sure the python interpreter is "#!/usr/bin/env python3" for nativesdk to avoid the shebang path exceeding the limit when install the sdk under the directory with long path. Before: $ cd ${target_sdk_dir} $ vi ./sysroots/x86_64-oesdk-linux/usr/bin/2to3 #!${target_sdk_dir}/sysroots/${SDK_SYS}/usr/bin/python3.9 [snip] After: $ cd ${target_sdk_dir} $ vi ./sysroots/x86_64-oesdk-linux/usr/bin/2to3 #!/usr/bin/env python3 [snip] (From OE-Core rev: a748e6098fa7d2ff594319937c7e0cf97700e83a) Signed-off-by: Mingli Yu <mingli.yu@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-23python3-magic: upgrade 0.4.18 -> 0.4.20Richard Purdie
License changed as there was additional copyright information added but the underlying license did not change. (From OE-Core rev: 97f5846586076c20289a2a43c7ddfa610a6aa5d9) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-23python3-pycryptodome/pycryptodomex: upgrade 3.9.9 -> 3.10.1Richard Purdie
The license file dropped the APL-2 pieces but this wasn't in LICENSE in the first place, no code seemed to refer to it so no change was needed. (From OE-Core rev: f31d3d8999ce314832012324ce8bebf42dcfb372) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-23python3: update to 3.9.2Oleksandr Kravchuk
Removed CVE patch was upstreamed. License-Update: copyright years. (From OE-Core rev: fafb8a88cd0365ff4327a1d6062d9f48b2927910) Signed-off-by: Oleksandr Kravchuk <open.source@oleksandr-kravchuk.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-18python3-setuptools: upgrade 52.0.0 -> 53.0.0Anuj Mittal
(From OE-Core rev: 875fd5cdece20e713c87c0c6a56b7162c735a55b) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-18python3-pytest: upgrade 6.2.1 -> 6.2.2Anuj Mittal
(From OE-Core rev: 3c46f173b1862beb0df054b300374d531a80654c) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-18python3-pygments: upgrade 2.7.4 -> 2.8.0Anuj Mittal
(From OE-Core rev: 1314897614ba2764d2abcf1f44a68a3b0283e2a5) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-18python3-more-itertools: upgrade 8.6.0 -> 8.7.0Anuj Mittal
(From OE-Core rev: eebc2694c9b591a3cd5f7c4870d5138ccebed748) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-18python3-hypothesis: upgrade 6.0.2 -> 6.2.0Anuj Mittal
(From OE-Core rev: f741a3321a08b639073d0ee4a7c6942bc37068bf) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-18python3-git: upgrade 3.1.12 -> 3.1.13Anuj Mittal
(From OE-Core rev: a0a0f55701f72c9fcdfde3c8b27d4f6f30cb7e2d) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-17python3-jinja2: upgrade 2.11.2 -> 2.11.3Richard Purdie
(From OE-Core rev: d6d469b73703fc8f0b30aa7f71525306a911a85c) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-09python3-packaging: upgrade 20.8 -> 20.9zhengruoqin
20.9 - 2021-01-29 ~~~~~~~~~~~~~~~~~ * Run [isort](https://pypi.org/project/isort/) over the code base (:issue:`377`) * Add support for the ``macosx_10_*_universal2`` platform tags (:issue:`379`) * Introduce ``packaging.utils.parse_wheel_filename()`` and ``parse_sdist_filename()`` (:issue:`387` and :issue:`389`) (From OE-Core rev: 6199c71030d527c57a1cb8496a377afb503d7670) Signed-off-by: Zheng Ruoqin <zhengrq.fnst@cn.fujitsu.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-09python3-setuptools: update 51.0.0 -> 52.0.0Alexander Kanavin
easy_install script removed upstream: https://github.com/pypa/setuptools/blob/v52.0.0/CHANGES.rst Tarballs are now provided instead of zip files. License-Update: formatting (From OE-Core rev: 131105f94c8de1f087e8bd6e3e76a5c38962ae7d) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-05python3-importlib-metadata: Add toml dependencyChanghyeok Bae
ERROR: Do not try to fetch 'toml' for building. Please add its native recipe to DEPENDS. (From OE-Core rev: 9adc8edccbd7b3f7c05d6e17a8ebde4e65bf6c81) Signed-off-by: Changhyeok Bae <changhyeok.bae@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-05python3-smmap: update to 4.0.0Oleksandr Kravchuk
(From OE-Core rev: 8f6025ed514a5114b7ec71edb8b1684e85fd29f4) Signed-off-by: Oleksandr Kravchuk <open.source@oleksandr-kravchuk.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-03python3: fix CVE-2021-3177Anuj Mittal
(From OE-Core rev: 2ed4f61e9d694fef8ff72b8eeb2163634e96c3bb) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-03python3-setuptools: Add back accidentally dropped RDEPENDSRichard Purdie
This was accidentally removed in a previous commit. Due to improvements in the core, we can now just add it as a normal RDEPENDS along with the others as the native case no longer causes issues. (From OE-Core rev: 83d8b469750d7917376abb4d34f7797ee0f75267) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-30python3: Use addtask statement instead of task dependenciesTomasz Dziendzielski
The externalsrc class deletes do_patch task which results with: | ERROR: Task do_create_manifest in <PATH>/python3_3.8.2.bb depends upon | non-existent task do_patch in <PATH>/python3_3.8.2.bb Use addtask to define correct order to prevent this error, since addtask mechanism accepts deleted tasks. [YOCTO #14151] (From OE-Core rev: a746d034fa7eaad4f4876fa61c5a8c3c15e211c8) Signed-off-by: Tomasz Dziendzielski <tomasz.dziendzielski@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-29meta: Clean up various class-native* RDEPENDS overridesRichard Purdie
With PACKAGES functioning more correctly for native recipes combined with classextend improvements over the years, there are various overrides of RDEPENDS which look unecessary now, clean them up. There some some minor changes in dependencies, specifically: "python3-numpy-native.do_populate_sysroot" -> "python3-native.do_populate_sysroot" "python3-mako-native.do_populate_sysroot" -> "python3-native.do_populate_sysroot" "itstool-native.do_populate_sysroot" -> "libxml2-native.do_populate_sysroot" however there are already: XXX-native.do_prepare_recipe_ssysroot -> YYY-native.do_populate_sysroot mappings from DEPENDS so this is effectively a null op. (From OE-Core rev: 2edd826531d79744d7b2114c5f24296966d51781) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-29native: Stop clearing PACKAGESRichard Purdie
Native recipes have been special and they don't have packages generated from them. The RDEPENDS/RPROVIDES and other runtime package specific variables can contain important data about dependencies recipes need though and currently it is required to write this information explicitly in the native case. We now delete the packaging tasks for native recipes which removes the need to clear PACKAGES. The next step to improve the metadata is to stop clearing it and ensure any entries in these variables are remapped appropriately. The R* variables were already being processed by the class extension code but the implementation was suboptimal. This patch stops clearing PACKAGES and PACKAGES_DYNAMIC and fixes the places where that caused issues in OE-Core, for example PACKAGES additions in anonymous python without the "-native" suffix and a case where the included classes caused a self reference in DEPENDS which would once have been removed by the previous code. The implementation uses datastore/parser parameters to ensure that the variable overrides are not overwritten when calling setVar which is appropriate for a function as close to the core as this one is. Some now unneeded code in python3-setuptools is dropped, there are further changes like this which can follow. This change was verified with OE-Core by comparing task-depends.dot generated by "bitbake world -g" before and after the change, the files were identical. (From OE-Core rev: fd6a007efa7cb45101a66f294af81d9d33bb3fab) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-29bitbake.conf/python: Drop setting RDEPENDS/RPROVIDES defaultRichard Purdie
We never recommend setting RDEPENDS or RPROVIDES without a package name against them. The default in bitbake.conf is legacy only, drop it. The python recipe was trying to add to the empty variable in the native case fix that too. (From OE-Core rev: b8bbc1bbe282cce2ea4d0ff293f931f6caf6153b) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-28python3: Avoid installing test data into recipe-sysrootRichard Purdie
There are several thousand files in the test directory which we don't need. Adding these for the native and target sysroots is a crazy amount of files to be throwing around needlessly. Delete the files from the sysroot side of things to tidy up the sysroots and improve performance. (From OE-Core rev: f6bced03011ad1663d68b0322a2f8aeb4d836646) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-20python3-hypothesis: upgrade 5.43.3 -> 6.0.2Anuj Mittal
(From OE-Core rev: c86ad19993b851a2c714eaf53330d83c28ad9cbd) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-20python3-dbusmock: upgrade 0.19 -> 0.22.0Anuj Mittal
(From OE-Core rev: 93777c3b4fd56aa50eceedb92c67446040f87837) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-20python3-git: upgrade 3.1.11 -> 3.1.12Anuj Mittal
(From OE-Core rev: 437f795cb1cb4d532ff90f82b819dee02ae0a0f7) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-20python3-importlib-metadata: upgrade 3.3.0 -> 3.4.0Anuj Mittal
(From OE-Core rev: eae5da8c0b331d39c91b6af2f990365615e0c294) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-20python3-mako: upgrade 1.1.3 -> 1.1.4Anuj Mittal
(From OE-Core rev: e93e2dd8e79842cf2a4d6b43befab16013eaab57) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-20python3-pygments: upgrade 2.7.3 -> 2.7.4Anuj Mittal
License-Update: change in copyright years (From OE-Core rev: a4c922785f658c5130ef60acd21f354050d20ea5) Signed-off-by: Anuj Mittal <anuj.mittal@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-12-31python3-pytest: update 6.1.2 -> 6.2.1Alexander Kanavin
(From OE-Core rev: 7c84d3b0112daa6006c35c19d66b544f7d2ef31b) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-12-30python3: update 3.9.0 -> 3.9.1Alexander Kanavin
(From OE-Core rev: 11935507525e9c5c0dd6dcb217bdfee0b07ebba9) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-12-30python3-importlib-metadata: update 3.1.1 -> 3.3.0Alexander Kanavin
Correct SRC_URI and upstream regex to enable automatic version upgrades. (From OE-Core rev: 5c04abf915b32481081c6eef41595d6f3db08613) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-12-30python3-setuptools-scm: upgrade 4.1.2 -> 5.0.1Alexander Kanavin
(From OE-Core rev: a63df7f1396ed1456c797cf396b3d365a133b1ee) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-12-30python3-py: upgrade 1.9.0 -> 1.10.0Alexander Kanavin
(From OE-Core rev: 7893aae402cd2df906cfe8b0d7fb799cc3049669) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>