[LTP] [ANNOUNCE] The Linux Test Project has been released for JANUARY 2024

Mon Feb 5 10:20:44 CET 2024

Hi!

Thank you very much for your work guys!
In particular, thanks to Petr Vorel and Cyril Hrubis who worked really 
hard to make this release happen.

Best regards,
Andrea Cervesato

On 1/30/24 12:13, Cyril Hrubis wrote:
> Good news everyone,
>
> the Linux Test Project test suite stable release for *January 2024* has been
> released.
>
> Since the last release 315 patches by 34 authors were merged.
>
> Patch review is what most of the projects struggle with and LTP is no
> different. If you can spare some effort helping with the patch review is more
> than welcomed.
>
> NOTABLE CHANGES
> ===============
>
> * New tests
>    - splice07, accept03, readahead01:
>
>      Tests that feeds the syscall all kinds of invalid file descriptors and
>      checks that the syscall fails properly.
>
>     - proc_sched_rt01 a regression test for:
>
>       c1fc6484e1fb ("sched/rt: sysctl_sched_rr_timeslice show default timeslice after reset")
>       079be8fc6309 ("sched/rt: Disallow writing invalid values to sched_rt_period_us")
>
>    - ksm07 a test for KSM smart-scan.
>
>    - pathconf02 negative testcases for pathconf()
>
>    - pipe15 A regresson test for:
>
>      46c4c9d1beb7 ("pipe: increase minimum default pipe size to 2 pages")
>
>    - nft02 A regression test for:
>
>       515ad530795c ("netfilter: nf_tables: do not ignore genmask when looking up chain by id") aka CVE-2023-31248
>
>    - sched_setscheduler04 a test for SCHED_RESET_ON_FORK
>
>    - setsockopt10 2c02d41d71f9 ("net/ulp: prevent ULP without clone op from entering the LISTEN status") aka CVE-2023-0461
>
>    - gettid02 A basic gettid02 test.
>
>    - splice06 A test that splicing from a /proc files works.
>
> * Increased coverage
>
>     - ioctl02 cover more modern termios ioctls() as well.
>
>     - fanotify13 More test coverage for overlayfs.
>
>     - input* test now check UI_GET_NAME ioctl() too.
>
> * Removed tests
>
>     - fork12 Which was a naive fork bomb test, we do have other tests
>              (setrlimit01.c, ...) that better cover this scenario.
>
>     - mongo test framework
>
>       Which was test reiser, ext2 and jfs unmaintained for a decade.
>
>     - simple_tracer.c Tracing test from 2009 that does not compile anymore.
>
>     - runtest/fsx-linux This is consolidation of runtest files, since these test
>                         duplicated in ltp-aiodio.part3.
>
>     - testscripts/autofs{1,4}.sh, testscripts/sysfs.sh,
>       testscripts/ltp-scsi_debug.sh, testscripts/ltpdmmapper.sh
>
>       These were unmaintained and unused scripts.
>
>     - scsi/* A testsuite with a custom kernel module for kernel 2.5 that didn't
>              compile cleanly for decades.
>
>     - load_stress_all_kernel_modules.sh Broken for quite some time.
>
> * The LTP library now has a functions to iterate over different
>    file descriptors. That allows us to easily implement more comprehensive tests
>    that feed various syscalls all possible file descriptors and check that the
>    syscall fails properly with invalid combinations. Most notable use of this
>    library is the newly introduced splice07.c test.
>
> * The minimal size of the device for a few filesystem tests was increased to
>    1GB because modern filesystems, most notably Btrfs does not work properly on
>    smaller devices.
>
> * LTP now tests bcachefs if kernel support and bcache.mkfs is present
>
> * 30 testcases were converted to the new test library
>
> + The usual amount of fixes and cleanups
>
> NOTABLE CHANGES IN NETWORK TESTS
> ================================
> brought to you by Petr Vorel
>
> The performance tests in net.features can be now skipped by setting
> LTP_NET_FEATURES_IGNORE_PERFORMANCE_FAILURE=1 which is useful when testing is
> executed on VMs on a overloaded host or if we are running tests with a
> background load.
>
> KIRK (previously RUNLTP-NG)
> ===========================
>
> Kirk was updated to v1.2
>
> This version brings the following updates:
>
>   - show both stdout and stderr when executing tests on host
>   - support for external commands on different SUTs
>   - warning message when SUT doesn't support parallel execution
>   - more stable epoll() communication with LTX
>   - minor fixes
>   - updated documentation
>
> DOWNLOAD AND LINKS
> ==================
>
> The latest version of the test-suite contains 3000+ tests for the Linux
> and can be downloaded at:
>
> https://github.com/linux-test-project/ltp/releases/tag/20240129
>
> The project pages as well as GIT repository are hosted on GitHub:
>
> https://github.com/linux-test-project/ltp
> http://linux-test-project.github.io/
>
> If you ever wondered how to write a LTP testcase, don't miss our developer
> documentation at:
>
> https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines
>
> https://github.com/linux-test-project/ltp/wiki/C-Test-API
>
> https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API
>
> https://github.com/linux-test-project/ltp/wiki/Shell-Test-API
>
> https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial
>
> https://github.com/linux-test-project/ltp/wiki/Build-System
>
> Patches, new tests, bugs, comments or questions should go to to our mailing
> list at ltp@lists.linux.it.
>
> CREDITS
> =======
>
> Many thanks to the people contributing to this release:
>
> git shortlog -s -e -n 20230929..
>
>     147  Petr Vorel <pvorel@suse.cz>
>      25  Yang Xu <xuyang2018.jy@fujitsu.com>
>      21  Andrea Cervesato <andrea.cervesato@suse.com>
>      18  Martin Doucha <mdoucha@suse.cz>
>      12  Cyril Hrubis <chrubis@suse.cz>
>      11  Marius Kittler <mkittler@suse.de>
>       8  Wei Gao <wegao@suse.com>
>       7  Amir Goldstein <amir73il@gmail.com>
>       7  Richard Palethorpe <rpalethorpe@suse.com>
>       6  Avinesh Kumar <akumar@suse.de>
>       6  Edward Liaw <edliaw@google.com>
>       6  Jan Kara <jack@suse.cz>
>       5  Jan Stancek <jstancek@redhat.com>
>       4  Hongchen Zhang <zhanghongchen@loongson.cn>
>       4  Kevin Brodsky <kevin.brodsky@arm.com>
>       4  Xiao Yang <yangx.jy@fujitsu.com>
>       3  Shiyang Ruan <ruansy.fnst@fujitsu.com>
>       2  Li Wang <liwang@redhat.com>
>       2  Li Zhijian <lizhijian@fujitsu.com>
>       2  Pengfei Xu <pengfei.xu@intel.com>
>       2  Stefan Roesch <shr@devkernel.io>
>       1  Alexander Kanavin <alex@linutronix.de>
>       1  Brennan Ashton <bashton@brennanashton.com>
>       1  Korobeynikov Gleb <mathkgd@mail.ru>
>       1  Marcos Paulo de Souza <mpdesouza@suse.com>
>       1  Mengchi Cheng <mengcc@amazon.com>
>       1  Murphy Zhou <jencce.kernel@gmail.com>
>       1  Shizhao Chen <shichen@redhat.com>
>       1  Shoukui Zhang <zhangshoukui@xiaomi.com>
>       1  Subramanya Swamy <subramanya.swamy.linux@gmail.com>
>       1  haopengxiang <haopengxiang@xiaomi.com>
>       1  nietingting <nietingting@xiaomi.com>
>       1  wangxuewen <wangxuewen@kylinos.cn>
>       1  ybonatakis <ybonatakis@suse.com>
>
> And also thanks to patch reviewers:
>
> git log 20230929.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
>
>      111 Petr Vorel <pvorel@suse.cz>
>       70 Cyril Hrubis <chrubis@suse.cz>
>       47 Li Wang <liwang@redhat.com>
>       35 Richard Palethorpe <rpalethorpe@suse.com>
>       14 Martin Doucha <mdoucha@suse.cz>
>        8 Amir Goldstein <amir73il@gmail.com>
>        7 Xiao Yang <yangx.jy@fujitsu.com>
>        7 Marius Kittler <mkittler@suse.de>
>        6 Jan Kara <jack@suse.cz>
>        4 Avinesh Kumar <akumar@suse.de>
>        3 Andrea Cervesato <andrea.cervesato@suse.com>
>        3 Jan Stancek <jstancek@redhat.com>
>        2 Yang Xu <xuyang2018.jy@fujitsu.com>
>        1 Petr Vorel <petr.vorel@gmail.com>
>        1 Christian Brauner <brauner@kernel.org>