[LTP] [kirk] Remove support for external testing suite
Andrea Cervesato
andrea.cervesato@suse.com
Mon Mar 31 11:52:55 CEST 2025
Hi all,
As you may know, Kirk supports the execution of certain kselftests and
liburing testing suites. It was initially created as an experiment.
We have made attempts to implement these features, but it seems we have
not succeeded. They appear to be largely unused by most users and are
creating a bottleneck for new Kirk implementations, such as the
automatic installation of LTP inside the SUT. This feature would be
particularly beneficial for QEMU vanilla images. We had it in the past
already and probably it's time to get this feature back. And we should
probably implement it for other testing suites due to the current API:
something that we really don't want to do (see eBPF kselftests compile
madness).
Another concern is the maintainability of supporting for additional
testing suites. While they are interesting, the implementation is
somewhat flawed. Each testing suite has its own
input/output/configuration/compilation methods, leading to confusion and
over-engineered solutions. While we understand that no solution is
perfect, it seems we have reached a point where Kirk = LTP. Therefore,
we should reconsider maintaining features that require updates due to
changes in external testing suites.
For these reasons, I propose that we remove support for the additional
testing suites and focus exclusively on LTP for Kirk maintenance.
What do you think?
Best regards,
Andrea Cervesato
More information about the ltp
mailing list