[Dev-luatex] scantokens in LuaTeX (issue 733)

[Bruno Le Floch]

Hello,

LuaTeX's \scantokens behave differently than eTeX's, as mentionned in
[issue 733 in the bug
tracker](http://tracker.luatex.org/view.php?id=733).  The issue 733
does not explicitly say what goes wrong, so I though I'd provide a
shorter example of the problem:

    pdftex '\newlinechar10 \scantokens{\show^^JX}Y'

shows "the letter X", while using luatex I get "the letter Y".  What
happens is that LuaTeX's \scantokens only reads the first line of the
pseudo file written by \scantokens.

Regards,

Bruno

PS: I tried directly commenting on issue 733 but couldn't find how,
please let me know if this mailing list is not the correct place.