Julien Olivain
2031fc8809
support/testing/tests/package/test_tcl.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
[Arnout: use f-string instead of string.format]
Signed-off-by: Arnout Vandecappelle <arnout@mind.be >
2023-09-17 22:09:40 +02:00
Julien Olivain
02497626ad
support/testing/tests/package/test_libgpgme.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-09-10 18:34:52 +02:00
Julien Olivain
fc942d5033
support/testing/tests/package/test_screen.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-09-10 18:32:49 +02:00
Julien Olivain
b492a5414e
support/testing/tests/package/test_less.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-09-10 18:32:27 +02:00
Peter Korsgaard
600e36f8f2
Merge branch 'next'
...
Signed-off-by: Peter Korsgaard <peter@korsgaard.com >
2023-09-07 16:50:14 +02:00
Julien Olivain
d44a888c32
support/testing: python-magic-wormhole: fix random failures
...
The magic-wormhole "receive" command can output "waiting" messages
when key receival or verification are longer than a predefined
timeout:
https://github.com/magic-wormhole/magic-wormhole/blob/0.13.0/src/wormhole/cli/cmd_receive.py#L135
The intent is to have an interactive user experience.
This behavior makes the runtime test unreliable as the test always
expect the sent message as the exact output. When the test execution
is slower, it sometimes get the "waiting" message instead of the
expected message.
Some test jobs are succeeding:
https://gitlab.com/buildroot.org/buildroot/-/jobs/4968059737
while some other are failing.
magic-wormhole can override those timers with environment variables.
See:
https://github.com/magic-wormhole/magic-wormhole/blob/0.13.0/src/wormhole/cli/cmd_receive.py#L26
This commit sets those environment variable to larger values
(100 seconds instread of 1 by default), to make sure the test will
always pass.
Fixes:
https://gitlab.com/buildroot.org/buildroot/-/jobs/4962923235
Reported-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Julien Olivain <ju.o@free.fr >
Reviewed-by: Romain Naour <romain.naour@gmail.com >
Tested-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-09-02 09:43:55 +02:00
Sebastian Weyer
bea949996e
support/testing/tests/package/test_nu.py: new runtime test
...
Load sample script support/testing/tests/package/sample_nu.nu onto the
target and verify proper execution by nushell
Signed-off-by: Sebastian Weyer <sebastian.weyer@smile.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-08-29 23:57:22 +02:00
Witold Lipieta
7412789bfd
package/python-segno: new package
...
segno 1.5.2 https://pypi.org/project/segno/
Signed-off-by: Witold Lipieta <witold.lipieta@thaumatec.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-08-24 23:43:28 +02:00
Yann E. MORIN
2423d9f16b
Merge tag '2023.08-rc2' into next
...
Conflicts:
- .checkpackageignore
- Makefile
- board/versal/post-image.sh
- package/sentry-cli/0001-Disable-SSL-support-for-the-curl-module.patch
=> keep version in next
- Config.in.legacy
=> merge, introduce legacy comment for 2023.11
- toolchain/toolchain-external/toolchain-external-bootlin/Config.in.options
=> regenerate, drop dependency on inexistant BR2_ARCH_NEEDS_GCC_AT_LEAST_14
Signed-off-by: Yann E. MORIN <yann.morin.1998@free.fr >
2023-08-21 21:36:17 +02:00
Julien Olivain
f4da6c3ebe
support/testing/tests/package/test_nftables.py: new runtime test
...
This runtime test was suggested in discussion [1]. It should detect
potential runtime failures such as the one fixed in commit eb74998125
"package/nftables: fix the build of the pyhon bindings".
We need a special kernel, because not all nftables-related options are
enabled in the pre-built one.
[1] https://lists.buildroot.org/pipermail/buildroot/2023-August/672864.html
Cc: Yann E. MORIN <yann.morin.1998@free.fr >
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Yann E. MORIN <yann.morin.1998@free.fr >
2023-08-20 16:25:21 +02:00
Julien Olivain
4edb0e3456
support/testing/tests/package/test_weston.py: new runtime test
...
This test is a followup of the discussion at:
https://lists.buildroot.org/pipermail/buildroot/2023-July/671639.html
It provides an example of a runtime tests using standard Linux graphic
components (Kernel, DRM, Mesa3D, weston).
Signed-off-by: Julien Olivain <ju.o@free.fr >
[yann.morin.1998@free.fr:
- use an overlay rather than create config file at runtime
- sleep in python not in target
- increase delay to capture DRI CRCs
]
Signed-off-by: Yann E. MORIN <yann.morin.1998@free.fr>
2023-08-12 20:18:52 +02:00
Julien Olivain
83671f395c
support/testing/tests/package/test_kmscube: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-08-10 21:48:32 +02:00
Romain Naour
084cc7df3f
support/testing: TestPolkitSystemd: fix systemctl exit code check on failure
...
As reported by [1] [2], the return code of systemctl command between
systemd 253 and 254 has changed when the polkit authentication is
refused:
/bin/systemctl restart systemd-timesyncd.service
The return code changed from 1 to 4. The Polkit test case
"TestPolkitSystemd" expected 1 as return code [3].
The service log is not the same either:
systemd v253:
Failed to restart systemd-timesyncd.service: Interactive authentication required.
systemd v254:
Failed to restart systemd-timesyncd.service: Access denied
git bisect report this commit:
959301cf9f
From the PR (to get more context):
https://github.com/systemd/systemd/pull/26365
Note: systemd doesn't recommend using systemctl exit code to check unit states:
"The mapping of LSB service states to systemd unit states is imperfect, so it is better to
not rely on those return values but to look for specific unit states and substates instead."
Since we only want to check if the command failed, update our test to
check if systemctl returned a non zero code whatever the reason of the
failure.
Thanks to Yann E. MORIN for the brainstorming!
Fixes:
https://gitlab.com/buildroot.org/buildroot/-/jobs/4768561464 (TestPolkitSystemd)
[1] http://lists.busybox.net/pipermail/buildroot/2023-August/671900.html
[2] https://lists.freedesktop.org/archives/systemd-devel/2023-August/049362.html
[3] https://git.buildroot.net/buildroot/tree/support/testing/tests/package/test_polkit.py?h=2023.08-rc1#n45
[4] https://github.com/systemd/systemd/blob/v254/man/systemctl.xml#L2612
Signed-off-by: Romain Naour <romain.naour@smile.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-08-09 19:21:27 +02:00
Romain Naour
c26a44b556
support/testing: TestLxc switch to the Arm Bootlin toolchain
...
TestLxc uses systemd as init but the recent update to systemd v254
requires a toolchain w/ linux headers >= 4.14 to provide
LOOP_SET_BLOCK_SIZE [1] (added in systemd v253 [2]).
Since no other toolchain that the Bootlin one is available
switch to it.
(ARM Arm toolchain requires BR2_ARM_CPU_HAS_NEON enabled)
[1] https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=89e4fdecb51cf5535867026274bc97de9480ade5
[2] 1163ddb386
Fixes:
https://gitlab.com/buildroot.org/buildroot/-/jobs/4768561390
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Yann E. MORIN <yann.morin.1998@free.fr >
2023-08-02 21:18:10 +02:00
Julien Olivain
6404185f72
support/testing/tests/package/test_fluidsynth.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-30 12:59:01 +02:00
Julien Olivain
f7f915fc4a
package/python-midiutil: new package
...
A pure python library for creating multi-track MIDI files.
https://github.com/MarkCWirt/MIDIUtil
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-30 12:58:41 +02:00
Julien Olivain
1367f3e465
support/testing/tests/package/test_glslsandbox_player.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-29 23:37:57 +02:00
Yegor Yefremov
a42b52163d
support/testing: add test for python-pysmb
...
Signed-off-by: Yegor Yefremov <yegorslists@googlemail.com >
[yann.morin.1998@free.fr: ignore flake8 warnings in test sample]
Signed-off-by: Yann E. MORIN <yann.morin.1998@free.fr>
2023-07-23 16:42:06 +02:00
Julien Olivain
d5e078a15c
support/testing/tests/package/test_lrzip.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Yann E. MORIN <yann.morin.1998@free.fr >
2023-07-23 16:32:04 +02:00
Julien Olivain
da0f92fdfc
support/testing/tests/package/test_pixz.py: use test_compressor_base
...
The test_pixz.py test was initially written as a standalone test.
The commit cf132a13
"support/testing/tests/package/test_compressor_base.py: new helper class"
introduced a helper class for testing data compression programs.
This commit rewrites this test to use this helper class.
The test coverage is mostly the same as before the rewrite. Notable
differences are:
- the test file is slightly smaller for faster testing,
- its content layout also slightly different.
Cc: Vincent Stehlé <vincent.stehle@laposte.net >
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-23 12:29:15 +02:00
Julien Olivain
3c0d12221e
support/testing/tests/package/test_lzip.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-23 12:28:48 +02:00
Julien Olivain
ca3c4d0007
support/testing/tests/package/test_gnuradio.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-22 23:14:25 +02:00
Julien Olivain
9e380d0581
support/testing/tests/package/test_gawk.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-21 23:35:44 +02:00
Julien Olivain
2fd06a0e57
support/testing/tests/package/test_zchunk.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-14 23:25:49 +02:00
Julien Olivain
78c7f45946
support/testing/tests/package/test_pigz.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-14 23:25:42 +02:00
Julien Olivain
305e74b2d8
support/testing/tests/package/test_lzop.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-14 23:25:38 +02:00
Julien Olivain
4fb4658c53
support/testing/tests/package/test_zstd.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-14 12:00:05 +02:00
Julien Olivain
0a6af11163
support/testing/tests/package/test_lz4.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-14 11:59:54 +02:00
Julien Olivain
d3142f032a
support/testing/tests/package/test_brotli.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-14 11:59:47 +02:00
Julien Olivain
d3534eca22
support/testing/tests/package/test_acpica.py: run runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-13 22:27:22 +02:00
Thomas Petazzoni
587d392df7
support/testing/tests/package/test_shadow: fix flake8 warning
...
Fixes:
support/testing/tests/package/test_shadow.py:3:1: F401 'infra.basetest.BASIC_TOOLCHAIN_CONFIG' imported but unused
Reported by https://gitlab.com/buildroot.org/buildroot/-/jobs/4643484762 .
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-13 00:14:34 +02:00
Romain Naour
109f22283c
support/testing: TestPythonPy3Txtorcon: use python base configuration
...
The base configuration now provide a glibc toolchain,
we can safely switch to it.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:30 +02:00
Romain Naour
0760784d1e
support/testing: TestPythonPy3Treq: use python base configuration
...
The base configuration now provide a glibc toolchain,
we can safely switch to it.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:29 +02:00
Romain Naour
e0e2bd6233
support/testing: TestPythonPy3ServiceIdentity: use python base configuration
...
The base configuration now provide a glibc toolchain,
we can safely switch to it.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:27 +02:00
Romain Naour
5fdb241dff
support/testing: TestPythonPy3MagicWormhole: use python base configuration
...
The base configuration now provide a glibc toolchain,
we can safely switch to it.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:26 +02:00
Romain Naour
f2652461c6
support/testing: TestPythonPy3Cryptography: use python base configuration
...
The base configuration now provide a glibc toolchain,
we can safely switch to it.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:24 +02:00
Romain Naour
1dd1a8c5cc
support/testing: TestPythonPy3Crossbar: use python base configuration
...
The base configuration now provide a glibc toolchain,
we can safely switch to it.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:23 +02:00
Romain Naour
8bf6175d91
support/testing: TestPythonPy3Autobahn: use python base configuration
...
The base configuration now provide a glibc toolchain,
we can safely switch to it.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:22 +02:00
Romain Naour
d9c24a6fb0
support/testing: TestPythonPy3SciPy: use python base configuration
...
The base configuration now provide a glibc toolchain,
we can safely switch to it.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:20 +02:00
Romain Naour
a9ad8ae22a
support/testing: TestZ3: use base configuration
...
The base configuration now provide a glibc toolchain,
we can safely switch to it.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:18 +02:00
Romain Naour
5ec2df9fcc
support/testing: TestMtools: use base configuration
...
The base configuration now provide a glibc toolchain,
we can safely switch to it.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:16 +02:00
Sebastian Weyer
f89f52168f
support/testing/infra/basetest.py: use Bootlin toolchain stable 2022.08-1
...
This patch updates the default toolchain used for runtime tests. The
last time this toolchain was updated was in commit
0207a65323 3 years ago. Since then,
multiple things have changed:
Firstly, it used uclibc-ng as the libc whereas since commit
4057e36ca9 , glibc is used as the default
library.
And secondly, since commit 531b2a10cd , buildroot
dropped the support for gcc 8 and it cannot be built internally anymore.
So the testsuite was executed using a toolchain that can't be built by
the Buildroot internal toolchain backend anymore.
This new Bootlin toolchain stable 2022.08-1 is based on gcc 11.3.0,
linux headers 4.9.327, glibc 2.35 and binutils 2.38.
The previous toolchain bleeding edge 2018.11-1 is based on gcc 8.2.0,
linux headers 4.14.80, uclibc 1.0.30 and binutils 2.31.1
Nowadays Bootlin toolchains are packaged in Buildroot and we can
directly select them from BASIC_TOOLCHAIN_CONFIG and avoid
setting the toolchain parameters (BR2_TOOLCHAIN_EXTERNAL_CUSTOM...).
The switch to Glibc requires to update some tests for the following
reasons:
- TestPython3Py, TestPython3Pyc and TestPython3PyPyc has been updated
since they use the libc binary file name in their test
(uClibc: libc.so.1 vs Glibc: libc.so.6).
- TestTmux needs at least one locale to pass (as stated in tmux help
text "tmux needs a working UTF-8 locale"), so use "C.UTF-8".
- TestOpenSsh needs a toolchain >= 5.x due to a openssh issue
(Similar to: https://bugs.busybox.net/show_bug.cgi?id=13671 )
Use the Bootlin toolchain bleeding-edge 2022.08-1 rhat provide
kernel headers 5.4
- TestShadow needs a toolchain >= 4.14
Use the Bootlin toolchain bleeding-edge 2022.08-1 rhat provide
kernel headers 5.4
Runtime tested on the gcc farm server.
Signed-off-by: Sebastian Weyer <sebastian.weyer@smile.fr >
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:14 +02:00
Romain Naour
dd4ba068b3
support/testing: TestPythonPy3Botocore: increase ext2 size to 250M
...
We are going to update the toolchain used by the Buildroot testsuite
and this update will increase the size of the rootfs over 120M.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:12 +02:00
Romain Naour
c2ba654925
support/testing: TestPythonPy3Boto3: increase ext2 size to 250M
...
We are going to update the toolchain used by the Buildroot testsuite
and this update will increase the size of the rootfs over 120M.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:10 +02:00
Romain Naour
a00d82f9e7
support/testing: TestPythonPy3S3transfer: increase ext2 size to 250M
...
We are going to update the toolchain used by the Buildroot testsuite
and this update will increase the size of the rootfs over 120M.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 23:22:09 +02:00
Julien Olivain
1b52f1e0b0
support/testing: test_perftest: update test kernel to 6.1.33
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 21:29:52 +02:00
Romain Naour
876ad67ac0
support/testing: TestGlxinfo: bump the toolchain to x86 core2 Bootlin toolchain stable 2022.08-1
...
This new Bootlin toolchain stable 2022.08-1 is based on gcc 11.3.0,
linux headers 4.9.327, glibc 2.35 and binutils 2.38.
Nowadays Bootlin toolchains are packaged in Buildroot and we can
directly select them from BASIC_TOOLCHAIN_CONFIG and avoid
setting the toolchain parameters (BR2_TOOLCHAIN_EXTERNAL_CUSTOM...).
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 12:05:02 +02:00
Romain Naour
bb3273ba9b
support/testing: TestGlxinfo: bump kernel version to 6.1.x
...
The kernel 6.1.x is the latest LTS version.
Signed-off-by: Romain Naour <romain.naour@gmail.com >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-12 12:04:58 +02:00
Julien Olivain
665303586a
support/testing/tests/package/test_xz.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-11 22:43:46 +02:00
Julien Olivain
1fcc0dcb00
support/testing/tests/package/test_bzip2.py: new runtime test
...
Signed-off-by: Julien Olivain <ju.o@free.fr >
Signed-off-by: Thomas Petazzoni <thomas.petazzoni@bootlin.com >
2023-07-11 22:43:40 +02:00