Hello,
LuaTeX's \scantokens behave differently than eTeX's, as mentionned in
[issue 733 in the bug
tracker](http://tracker.luatex.org/view.php?id=733). The issue 733
does not explicitly say what goes wrong, so I though I'd provide a
shorter example of the problem:
pdftex '\newlinechar10 \scantokens{\show^^JX}Y'
shows "the letter X", while using luatex I get "the letter Y". What
happens is that LuaTeX's \scantokens only reads the first line of the
pseudo file written by \scantokens.
Regards,
Bruno
PS: I tried directly commenting on issue 733 but couldn't find how,