N
Netocrat
I wouldn't want the suite to be part of the standard. Again, I'm biased
by my experience with the Ada validation suite. That suite is not part
of the standard, and where a test conflicts with the standard, the
standard wins.
That's fine everywhere the Standard is well-specified, which isn't the
case for 5.2.4 where a uniform test can't rely on a universal "one
program".
[...]
A validation suite is also a valuable tool for compiler developers. If
you introduce an obscure bug, there's a decent chance that you'll catch
it next time you run the validation tests.
Sure; as Chris Hills points out there are several commercial suites in
existence. Looking very briefly at what's publicly available I've found
a set of tests with gcc's source (some non-standard) and a set of
preprocessor validation tests accompanying MCPP (which I haven't
downloaded or looked at but which are promoted as comprehensive).