<div dir="ltr">audit-testsuite started failing recently (yesterday) because a lot of work was merged upstream and some new tests are testing functionality not available in RHEL yet. Please waive all audit-testsuite results and I will correct our beaker wrapper in the meantime.<br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Mar 10, 2020 at 10:45 AM CKI Project <<a href="mailto:cki-project@redhat.com">cki-project@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><br>
Hello,<br>
<br>
We ran automated tests on a recent commit from this kernel tree:<br>
<br>
Kernel repo: <a href="https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git" rel="noreferrer" target="_blank">https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git</a><br>
Commit: 6afe1f4aeae9 - ASoC: topology: Fix memleak in soc_tplg_manifest_load()<br>
<br>
The results of these automated tests are provided below.<br>
<br>
Overall result: FAILED (see details below)<br>
Merge: OK<br>
Compile: OK<br>
Tests: PANICKED<br>
<br>
All kernel binaries, config files, and logs are available for download here:<br>
<br>
<a href="https://cki-artifacts.s3.us-east-2.amazonaws.com/index.html?prefix=datawarehouse/2020/03/09/480618" rel="noreferrer" target="_blank">https://cki-artifacts.s3.us-east-2.amazonaws.com/index.html?prefix=datawarehouse/2020/03/09/480618</a><br>
<br>
One or more kernel tests failed:<br>
<br>
s390x:<br>
❌ LTP<br>
<br>
ppc64le:<br>
❌ LTP<br>
❌ audit: audit testsuite test<br>
<br>
aarch64:<br>
❌ audit: audit testsuite test<br>
<br>
x86_64:<br>
❌ audit: audit testsuite test<br>
<br>
We hope that these logs can help you find the problem quickly. For the full<br>
detail on our testing procedures, please scroll to the bottom of this message.<br>
<br>
Please reply to this email if you have any questions about the tests that we<br>
ran or if you have any suggestions on how to make future tests more effective.<br>
<br>
,-. ,-.<br>
( C ) ( K ) Continuous<br>
`-',-.`-' Kernel<br>
( I ) Integration<br>
`-'<br>
______________________________________________________________________________<br>
<br>
Compile testing<br>
---------------<br>
<br>
We compiled the kernel for 4 architectures:<br>
<br>
aarch64:<br>
make options: -j30 INSTALL_MOD_STRIP=1 targz-pkg<br>
<br>
ppc64le:<br>
make options: -j30 INSTALL_MOD_STRIP=1 targz-pkg<br>
<br>
s390x:<br>
make options: -j30 INSTALL_MOD_STRIP=1 targz-pkg<br>
<br>
x86_64:<br>
make options: -j30 INSTALL_MOD_STRIP=1 targz-pkg<br>
<br>
<br>
Hardware testing<br>
----------------<br>
We booted each kernel and ran the following tests:<br>
<br>
aarch64:<br>
Host 1:<br>
✅ Boot test<br>
✅ Podman system integration test - as root<br>
✅ Podman system integration test - as user<br>
✅ LTP<br>
✅ Loopdev Sanity<br>
✅ Memory function: memfd_create<br>
✅ AMTU (Abstract Machine Test Utility)<br>
✅ Networking bridge: sanity<br>
✅ Ethernet drivers sanity<br>
✅ Networking MACsec: sanity<br>
✅ Networking socket: fuzz<br>
✅ Networking sctp-auth: sockopts test<br>
✅ Networking: igmp conformance test<br>
✅ Networking route: pmtu<br>
✅ Networking route_func - local<br>
✅ Networking route_func - forward<br>
✅ Networking TCP: keepalive test<br>
✅ Networking UDP: socket<br>
✅ Networking tunnel: geneve basic test<br>
✅ Networking tunnel: gre basic<br>
✅ L2TP basic test<br>
✅ Networking tunnel: vxlan basic<br>
✅ Networking ipsec: basic netns - transport<br>
✅ Networking ipsec: basic netns - tunnel<br>
❌ audit: audit testsuite test<br>
✅ httpd: mod_ssl smoke sanity<br>
✅ tuned: tune-processes-through-perf<br>
✅ ALSA PCM loopback test<br>
✅ ALSA Control (mixer) Userspace Element test<br>
✅ storage: SCSI VPD<br>
✅ trace: ftrace/tracer<br>
🚧 ✅ CIFS Connectathon<br>
🚧 ✅ POSIX pjd-fstest suites<br>
🚧 ✅ jvm - DaCapo Benchmark Suite<br>
🚧 ✅ jvm - jcstress tests<br>
🚧 ✅ Memory function: kaslr<br>
🚧 ✅ LTP: openposix test suite<br>
🚧 ✅ Networking vnic: ipvlan/basic<br>
🚧 ✅ iotop: sanity<br>
🚧 ✅ Usex - version 1.9-29<br>
🚧 ✅ storage: dm/common<br>
<br>
Host 2:<br>
✅ Boot test<br>
✅ xfstests - ext4<br>
✅ xfstests - xfs<br>
✅ selinux-policy: serge-testsuite<br>
✅ lvm thinp sanity<br>
✅ storage: software RAID testing<br>
✅ stress: stress-ng<br>
🚧 ✅ IPMI driver test<br>
🚧 ✅ IPMItool loop stress test<br>
🚧 ✅ Storage blktests<br>
<br>
ppc64le:<br>
Host 1:<br>
<br>
⚡ Internal infrastructure issues prevented one or more tests (marked<br>
with ⚡⚡⚡) from running on this architecture.<br>
This is not the fault of the kernel that was tested.<br>
<br>
✅ Boot test<br>
⚡⚡⚡ Podman system integration test - as root<br>
⚡⚡⚡ Podman system integration test - as user<br>
⚡⚡⚡ LTP<br>
⚡⚡⚡ Loopdev Sanity<br>
⚡⚡⚡ Memory function: memfd_create<br>
⚡⚡⚡ AMTU (Abstract Machine Test Utility)<br>
⚡⚡⚡ Networking bridge: sanity<br>
⚡⚡⚡ Ethernet drivers sanity<br>
⚡⚡⚡ Networking MACsec: sanity<br>
⚡⚡⚡ Networking socket: fuzz<br>
⚡⚡⚡ Networking sctp-auth: sockopts test<br>
⚡⚡⚡ Networking route: pmtu<br>
⚡⚡⚡ Networking route_func - local<br>
⚡⚡⚡ Networking route_func - forward<br>
⚡⚡⚡ Networking TCP: keepalive test<br>
⚡⚡⚡ Networking UDP: socket<br>
⚡⚡⚡ Networking tunnel: geneve basic test<br>
⚡⚡⚡ Networking tunnel: gre basic<br>
⚡⚡⚡ L2TP basic test<br>
⚡⚡⚡ Networking tunnel: vxlan basic<br>
⚡⚡⚡ Networking ipsec: basic netns - tunnel<br>
⚡⚡⚡ audit: audit testsuite test<br>
⚡⚡⚡ httpd: mod_ssl smoke sanity<br>
⚡⚡⚡ tuned: tune-processes-through-perf<br>
⚡⚡⚡ ALSA PCM loopback test<br>
⚡⚡⚡ ALSA Control (mixer) Userspace Element test<br>
⚡⚡⚡ trace: ftrace/tracer<br>
🚧 ⚡⚡⚡ CIFS Connectathon<br>
🚧 ⚡⚡⚡ POSIX pjd-fstest suites<br>
🚧 ⚡⚡⚡ jvm - DaCapo Benchmark Suite<br>
🚧 ⚡⚡⚡ jvm - jcstress tests<br>
🚧 ⚡⚡⚡ Memory function: kaslr<br>
🚧 ⚡⚡⚡ LTP: openposix test suite<br>
🚧 ⚡⚡⚡ Networking vnic: ipvlan/basic<br>
🚧 ⚡⚡⚡ iotop: sanity<br>
🚧 ⚡⚡⚡ Usex - version 1.9-29<br>
🚧 ⚡⚡⚡ storage: dm/common<br>
<br>
Host 2:<br>
✅ Boot test<br>
✅ xfstests - ext4<br>
✅ xfstests - xfs<br>
✅ selinux-policy: serge-testsuite<br>
✅ lvm thinp sanity<br>
✅ storage: software RAID testing<br>
🚧 ✅ IPMI driver test<br>
🚧 ✅ IPMItool loop stress test<br>
🚧 ✅ Storage blktests<br>
<br>
Host 3:<br>
✅ Boot test<br>
✅ Podman system integration test - as root<br>
✅ Podman system integration test - as user<br>
❌ LTP<br>
✅ Loopdev Sanity<br>
✅ Memory function: memfd_create<br>
✅ AMTU (Abstract Machine Test Utility)<br>
✅ Networking bridge: sanity<br>
✅ Ethernet drivers sanity<br>
✅ Networking MACsec: sanity<br>
✅ Networking socket: fuzz<br>
✅ Networking sctp-auth: sockopts test<br>
✅ Networking route: pmtu<br>
✅ Networking route_func - local<br>
✅ Networking route_func - forward<br>
✅ Networking TCP: keepalive test<br>
✅ Networking UDP: socket<br>
✅ Networking tunnel: geneve basic test<br>
✅ Networking tunnel: gre basic<br>
✅ L2TP basic test<br>
✅ Networking tunnel: vxlan basic<br>
✅ Networking ipsec: basic netns - tunnel<br>
❌ audit: audit testsuite test<br>
✅ httpd: mod_ssl smoke sanity<br>
✅ tuned: tune-processes-through-perf<br>
✅ ALSA PCM loopback test<br>
✅ ALSA Control (mixer) Userspace Element test<br>
✅ trace: ftrace/tracer<br>
🚧 ✅ CIFS Connectathon<br>
🚧 ✅ POSIX pjd-fstest suites<br>
🚧 ✅ jvm - DaCapo Benchmark Suite<br>
🚧 ✅ jvm - jcstress tests<br>
🚧 ✅ Memory function: kaslr<br>
🚧 ✅ LTP: openposix test suite<br>
🚧 ✅ Networking vnic: ipvlan/basic<br>
🚧 ✅ iotop: sanity<br>
🚧 ✅ Usex - version 1.9-29<br>
🚧 ✅ storage: dm/common<br>
<br>
s390x:<br>
Host 1:<br>
✅ Boot test<br>
✅ selinux-policy: serge-testsuite<br>
✅ stress: stress-ng<br>
🚧 ✅ Storage blktests<br>
<br>
Host 2:<br>
✅ Boot test<br>
✅ Podman system integration test - as root<br>
✅ Podman system integration test - as user<br>
❌ LTP<br>
⚡⚡⚡ Loopdev Sanity<br>
⚡⚡⚡ Memory function: memfd_create<br>
⚡⚡⚡ Networking bridge: sanity<br>
⚡⚡⚡ Ethernet drivers sanity<br>
⚡⚡⚡ Networking MACsec: sanity<br>
⚡⚡⚡ Networking sctp-auth: sockopts test<br>
⚡⚡⚡ Networking route: pmtu<br>
⚡⚡⚡ Networking route_func - local<br>
⚡⚡⚡ Networking route_func - forward<br>
⚡⚡⚡ Networking TCP: keepalive test<br>
⚡⚡⚡ Networking UDP: socket<br>
⚡⚡⚡ Networking tunnel: geneve basic test<br>
⚡⚡⚡ Networking tunnel: gre basic<br>
⚡⚡⚡ L2TP basic test<br>
⚡⚡⚡ Networking tunnel: vxlan basic<br>
⚡⚡⚡ Networking ipsec: basic netns - transport<br>
⚡⚡⚡ Networking ipsec: basic netns - tunnel<br>
⚡⚡⚡ audit: audit testsuite test<br>
⚡⚡⚡ httpd: mod_ssl smoke sanity<br>
⚡⚡⚡ tuned: tune-processes-through-perf<br>
⚡⚡⚡ trace: ftrace/tracer<br>
🚧 ⚡⚡⚡ CIFS Connectathon<br>
🚧 ⚡⚡⚡ POSIX pjd-fstest suites<br>
🚧 ⚡⚡⚡ jvm - DaCapo Benchmark Suite<br>
🚧 ⚡⚡⚡ jvm - jcstress tests<br>
🚧 ⚡⚡⚡ Memory function: kaslr<br>
🚧 ⚡⚡⚡ LTP: openposix test suite<br>
🚧 ⚡⚡⚡ Networking vnic: ipvlan/basic<br>
🚧 ⚡⚡⚡ iotop: sanity<br>
🚧 ⚡⚡⚡ Usex - version 1.9-29<br>
🚧 ⚡⚡⚡ storage: dm/common<br>
<br>
x86_64:<br>
Host 1:<br>
✅ Boot test<br>
✅ Storage SAN device stress - mpt3sas driver<br>
<br>
Host 2:<br>
✅ Boot test<br>
✅ Storage SAN device stress - megaraid_sas<br>
<br>
Host 3:<br>
<br>
⚡ Internal infrastructure issues prevented one or more tests (marked<br>
with ⚡⚡⚡) from running on this architecture.<br>
This is not the fault of the kernel that was tested.<br>
<br>
⚡⚡⚡ Boot test<br>
⚡⚡⚡ xfstests - ext4<br>
⚡⚡⚡ xfstests - xfs<br>
⚡⚡⚡ selinux-policy: serge-testsuite<br>
⚡⚡⚡ lvm thinp sanity<br>
⚡⚡⚡ storage: software RAID testing<br>
⚡⚡⚡ stress: stress-ng<br>
🚧 ⚡⚡⚡ IOMMU boot test<br>
🚧 ⚡⚡⚡ IPMI driver test<br>
🚧 ⚡⚡⚡ IPMItool loop stress test<br>
🚧 ⚡⚡⚡ power-management: cpupower/sanity test<br>
🚧 ⚡⚡⚡ Storage blktests<br>
<br>
Host 4:<br>
✅ Boot test<br>
✅ Podman system integration test - as root<br>
✅ Podman system integration test - as user<br>
✅ LTP<br>
✅ Loopdev Sanity<br>
✅ Memory function: memfd_create<br>
✅ AMTU (Abstract Machine Test Utility)<br>
✅ Networking bridge: sanity<br>
✅ Ethernet drivers sanity<br>
✅ Networking MACsec: sanity<br>
✅ Networking socket: fuzz<br>
✅ Networking sctp-auth: sockopts test<br>
✅ Networking: igmp conformance test<br>
✅ Networking route: pmtu<br>
✅ Networking route_func - local<br>
✅ Networking route_func - forward<br>
✅ Networking TCP: keepalive test<br>
✅ Networking UDP: socket<br>
✅ Networking tunnel: geneve basic test<br>
✅ Networking tunnel: gre basic<br>
✅ L2TP basic test<br>
✅ Networking tunnel: vxlan basic<br>
✅ Networking ipsec: basic netns - transport<br>
✅ Networking ipsec: basic netns - tunnel<br>
❌ audit: audit testsuite test<br>
✅ httpd: mod_ssl smoke sanity<br>
✅ tuned: tune-processes-through-perf<br>
✅ pciutils: sanity smoke test<br>
✅ ALSA PCM loopback test<br>
✅ ALSA Control (mixer) Userspace Element test<br>
✅ storage: SCSI VPD<br>
✅ trace: ftrace/tracer<br>
🚧 ✅ CIFS Connectathon<br>
🚧 ✅ POSIX pjd-fstest suites<br>
🚧 ✅ jvm - DaCapo Benchmark Suite<br>
🚧 ✅ jvm - jcstress tests<br>
🚧 ✅ Memory function: kaslr<br>
🚧 ✅ LTP: openposix test suite<br>
🚧 ✅ Networking vnic: ipvlan/basic<br>
🚧 ✅ iotop: sanity<br>
🚧 ✅ Usex - version 1.9-29<br>
🚧 ✅ storage: dm/common<br>
<br>
Host 5:<br>
✅ Boot test<br>
✅ xfstests - ext4<br>
✅ xfstests - xfs<br>
✅ selinux-policy: serge-testsuite<br>
✅ lvm thinp sanity<br>
✅ storage: software RAID testing<br>
✅ stress: stress-ng<br>
🚧 ✅ IOMMU boot test<br>
🚧 ✅ Storage blktests<br>
<br>
Test sources: <a href="https://github.com/CKI-project/tests-beaker" rel="noreferrer" target="_blank">https://github.com/CKI-project/tests-beaker</a><br>
💚 Pull requests are welcome for new tests or improvements to existing tests!<br>
<br>
Aborted tests<br>
-------------<br>
Tests that didn't complete running successfully are marked with ⚡⚡⚡.<br>
If this was caused by an infrastructure issue, we try to mark that<br>
explicitly in the report.<br>
<br>
Waived tests<br>
------------<br>
If the test run included waived tests, they are marked with 🚧. Such tests are<br>
executed but their results are not taken into account. Tests are waived when<br>
their results are not reliable enough, e.g. when they're just introduced or are<br>
being fixed.<br>
<br>
Testing timeout<br>
---------------<br>
We aim to provide a report within reasonable timeframe. Tests that haven't<br>
finished running yet are marked with ⏱.<br>
<br>
</blockquote></div>