On 6/10/2013 12:59 PM, Sietse Brouwer wrote:

Hi, all,

There appear to be a number of test suites in existence.

(1) The suite on pragma-ade.com. I suspect this is the one Hans actually uses. http://www.pragma-ade.com/download-1.htm (click on cont-tst.7z)

(2) The project on foundry.supelec.fr. Most recent file is 3 years old, and most of them are 6-7 years old, AFAICT. Summary: https://foundry.supelec.fr/projects/contexttest/ Files: https://foundry.supelec.fr/scm/viewvc.php/?root=contexttest This is also the suite described on http://wiki.contextgarden.net/Test_suite

(3) The ConTeXt unofficial test suite https://github.com/melmothx/context-unofficial-test-suite

I want to update the [[Test suite]] page to make it more accurate. So, I'm asking y'all: any inaccuracies in the text at the bottom of this e-mail?

Cheers, Sietse

* The test suite at pragma-ade.com is Hans's test suite; he runs this suite before uploading a new beta (most times). To contribute a test to this suite, write it in an e-mail and send it to the mailing list.

not true: I add examples when I add new functionality and sometimes turn examples from the mailing list in suite examples. I don't run the suite before a beta (I did when the most recent current was made) but Lukáš runs them every now and then and send me an overview of files that fail at his end (some files that need special fonts are excluded). So, I fix (when needed) issues that show up with the suite.

QUESTION: when one downloads and unzips this file in a directory, how does one run it?

Lukáš has his own scripts. Here I can run this: mtxrun --script testsuite --compare --oldname=cld-compare-old --newname=cld-compare-new --pattern=**/*.cld mtxrun --script testsuite --compare --oldname=mkiv-compare-old --newname=mkiv-compare-mkiv --pattern=**/*.mkiv mtxrun --script testsuite --compare --oldname=mkvi-compare-old --newname=mkvi-compare-mkiv --pattern=**/*.mkvi mtxrun --script testsuite --compare --oldname=tex-compare-old --newname=tex-compare-new --pattern=**/*.tex but that's probably a different method. As it takes a while I must admit that i only ran it for the current (as I do have more fonts on my system).

* The test suite at github is managed by users, especially Marco Patzer. To run the suite, just download it and run `run-suite.pl`.

Indeed. That one compares output too I think and it can generate reports as well.

* The test suite at foundry.supelec.fr is no longer being used.

I don't know.

QUESTION: are the tests in it already transferred to Hans or Marco's test suite? If not, is that still something we want to do, or can we just bury this suite entirely?

I don't know. I happily leave that to others to sort out. Hans ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com | www.pragma-pod.nl -----------------------------------------------------------------