Hello there! TL;DR: https://github.com/melmothx/context-unofficial-test-suite A week ago I had a conversation with mpfusion and another user over IRC about the ConTeXt test suite. mpfusion had a tarball with some test and an elaborate machinery to see if the testfiles compile. He kindly provided the tarball, and I took the liberty to do it my way (I didn't hear back from him, I assume he's working on his solution), using the testfiles and rewriting the code. My solution is quite simple, is written in perl (300 lines all included) and probably is not portable to non-unix machines. It uses imagemagick and pdftoppm to raster the PDF, and it's resonably fast (with a trick to speed up the difference parsing). It produces an ascii table like this: ./run-test.pl --run Using /usr/local/bin/context mtx-context | ConTeXt Process Management 0.52 mtx-context | mtx-context | main context file: /usr/local/texlive/2012/texmf-dist/tex/context/base/context.mkiv mtx-context | current version: 2012.05.30 11:26 ................. | File name | Success | Differs Avg | Worst value | Pages | Time | | arrows-001 | OK | 0.000000 | 0.000000 | 1 | 2 | | catcodes-001 | OK | 0.000000 | 0.000000 | 1 | 2 | | columnsets-001 | OK | 0.000000 | 0.000000 | 10 | 4 | | date-002 | OK | 0.000000 | 0.000000 | 1 | 2 | | dates-001 | OK | 0.605634 | 0.605634 | 1 | 2 | | dates-002 | OK | 0.000000 | 0.000000 | 1 | 3 | | hsv-001 | OK | 0.000000 | 0.000000 | 8 | 5 | | inclusion | OK | 0.000000 | 0.000000 | 1 | 2 | | metapost-001 | OK | 0.000000 | 0.000000 | 1 | 2 | | metapost-002 | OK | 0.000000 | 0.000000 | 1 | 2 | | mixed-001 | OK | 0.000000 | 0.000000 | 2 | 2 | | narrower-bidi-001 | OK | 0.000000 | 0.000000 | 4 | 2 | | ppchtex-001 | OK | 0.000000 | 0.000000 | 1 | 2 | | ppchtex-005 | OK | 0.000000 | 0.000000 | 1 | 2 | | ppchtex-006 | OK | 0.000000 | 0.000000 | 1 | 2 | | spot-001 | OK | 0.000000 | 0.000000 | 1 | 3 | | tables-001 | OK | 0.000000 | 0.000000 | 1 | 1 | It leaves the visual diffs as png images under diffs/ I'd like to know if there is some interest in this thing, as (obviously) the test suit is not really populated to have any kind of value. There is also room for improvement (like custom arguments to the compilation). Happy euroTeXt to the lucky partecipants. Enjoy! Best wishes -- Marco