SuperTest compiler test and validation suite

It is the responsibility of the compiler engineer to produce compilers that are able to face the outside world. Yet, determining the quality and robustness of a compiler is an extremely complicated task. This is because C and C++ are used in such a wide range of applications, from small embedded systems to large distributed database applications. In addition, many third- and fourth generation application generator tools produce code that is very often unlike that which a human programmer would write. In obtaining confidence in the quality and robustness of their product, compiler developers need the ability to be aware of and identify problems in the compiler well before users encounter them in their application programs. SuperTest is the world’s most comprehensive compiler test and validation suite that is coming from ACE’s 30+ years of experience and expertise in compiler construction. The SuperTest suite contains over sixteen thousand source files and provides well over 2 million quality and conformance tests. The procedures include both positive and negative tests and allow for selective testing of test subsets and previously failed tests. The straightforward user interface allows easy addition of new tests, and provides cross-validation support. The language conformance checks included in SuperTest check the compiler against ISO/IEC 9899 C, ISO/IEC 14882 C++, ISO/IEC TR 18037 Embedded C and DSP-C specifications. The included tests verify the compiler, using a comprehensive collection of compiler issues that has grown from decades of compiler construction and validation at ACE, as well as from the community of CoSy users. The SuperTest depth test suite verifies the compiler’s ability to correctly handle combinations of function calls, operators, storage classes, data types and pointer indirection levels. The built-in regression support eases tracking of progress towards validation and catches quality lapses. Ongoing R&D at ACE aim to further strengthen the leading position of the SuperTest suite, with new nasty test cases stretching compilers to the limits and ultimately enabling the construction of most robust compilers.

Contact ACE

If you are interested in more details about using SuperTest for testing the quality and robustness of the C/C++ compilers that you use or develop, then do not hesitate to contact us or fill out the web-request form.