[LTP] [RFC][PATCH 0/2] Merge runtest files

[Li Wang]

On Thu, Apr 3, 2025 at 11:47 PM Cyril Hrubis <chrubis@suse.cz> wrote:

> Hi!
> > this is a _huge_ topic that might affect LTP automation configurations.
> >
> > It's a job that IMHO should be done, but it makes more sense to wait for
> > testing suites definition in metadata, as well as a total refactoring of
> > old LTP tests.
>
> For a bigger changes yes. I would say that eliminating runtest files
> with a single test could be done sooner.
>
+1.

Even if metadata is used to organize cases in an automated way in the
future,
runtest files will still be a readable and straightforward way to
categorize.
They can be used as independent ways to help organizations IMO.



>
> > The reason of my statements is not only that runtest files should be
> > removed one day, but also that known issues inside products which are
> > tested, often require years of analysis of the runtest files and their
> > executions. By shuffling tests around will create issues where there's
> > no need due to a small logical improvement.
>
> I do not think that it's as severe as you describe it. We change runtest
> files a lot in each release and additions to runtest/syscall are the most
> frequent.
>
> > I think we should start to push more on testing suites definition inside
> > metadata and to refactor tests as fast as possible. So we will be free
> > from runtest files, leading to a more coherent structure of the tests
> > organization.
>
> We are getting there slowly, but I'm afraid that it will take years to
> get there.
>
> --
> Cyril Hrubis
> chrubis@suse.cz
>
>

-- 
Regards,
Li Wang