- dev-luatex - NTG Mailing Lists

Re: [Dev-luatex] [lltx] \scantokens differs between LaTeX and plain?
by Martin Schröder 15 Nov '11

15 Nov '11

2011/11/15 Heiko Oberdiek <heiko.oberdiek(a)googlemail.com>: > As result of "pdftex --ini --etex" macro:->a b is printed. > "luatex --ini --etex" breaks with an error: > > Runaway definition? > ->a > ! File ended while scanning definition of \x. > <inserted text> > } > l.9 \edef\x{\scantokens{a > b\noexpand} > } > ? Thanks; I've opened an bug report at http://tracker.luatex.org/view.php?id=733 Best Martin

1 0

The explanation of \directlua in the manual
by Javier Múgica de Rivera 20 Oct '11

20 Oct '11

>> Note that the expansion of \directlua is a sequence of characters, not >> of tokens, contrary to all TeX commands. So formally speaking its >> expansion is null, but places material on a pseudo-file to be >> immediately read by TeX, as etex's \scantokens. >> >> For a description of print functions look at section 4.13.10. >Is that really true? When you assign catcodes (catcode tables) to the print functions, >TeX's behavior is different from scantokens. I have never used scantokens, so I am >not 100% sure. Take for example: > >tex.print(-2, "\\def\\foo{abc}") > >will not define \foo. While you have referenced the section with the print commands, I >think that the description is misleading. > >Patrick The section on print commands says: "The arguments to these three functions are all stored in an in-memory virtual file that is fed to the TEX scanner as the result of the expansion of \directlua." An so what is fed to TEX are characters, no tokens. Your example, indeed, is a good one to exhibit that behaviour. The fact that you can change the catcodes and read the string again shows that TEX reads characters, tokenizing them. If it where not and the expansion were a sequence of tokens then \foo would get defined. Your example is like \def\scanasothers#1{ <set up catcodes as the value -2 for the first argument of tex.print does> \scantokens{#1} <reset catcodes> } \scanasothers{def\foo{abc}} This actual example suffices: \def\scanasothers#1{ \catcode`\\=12 \scantokens{#1} \catcode`\\=0 } \scanasothers{\def\foo{abc}} \show\foo \end Which reports > \foo=undefined. l.8 \show\foo and the dvi output includes the \'s output as " (the character in the font at the position of \). Javier

2 1

The explanation of \directlua in the manual
by Javier Múgica de Rivera 17 Oct '11

17 Oct '11

When I read this from the manual a long time ago: The \directlua command is expandable: the results of the LUA code become effective immediately. I could not make sense of it, and actually cannot up to day. What are "the results of the LUA code"? What does "become effective" mean? Now I now the answers to those questions but not because of the explanation given there. The example provided does not help much either. Note that this comes very soon in the manual. I propose the following wording: The \directlua command is expandable. Since it passes Lua code to the Lua interpreter its expansion from the TeX viewpoint is usually empty. However, there are some Lua functions that produce material to be read by TeX, the so called print functions. The most simple use of these is tex.print(<string> s). The characters of the string s will be placed on TeX input buffer, that is, "before TeX's eyes" to be read by TeX immediately. For example: \count10=20 a\directlua{tex.print(tex.count[10]+5)}b expands to a25b Here is another example: $\pi = \directlua{tex.print(math.pi)}$ will result in p = 3.1415926535898 Note that the expansion of \directlua is a sequence of characters, not of tokens, contrary to all TeX commands. So formally speaking its expansion is null, but places material on a pseudo-file to be immediately read by TeX, as etex's \scantokens. For a description of print functions look at section 4.13.10. Regards, Javier A. Múgica

3 2

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 14 Oct '11

14 Oct '11

------------------------------------------------------------------------ r4358 | taco | 2011-10-14 10:45:59 +0200 (Fri, 14 Oct 2011) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/pdf/pdfgen.w M /trunk/source/texk/web2c/luatexdir/tex/filename.w M /trunk/source/texk/web2c/luatexdir/tex/maincontrol.w underscore identifiers patch from minux ------------------------------------------------------------------------

1 0

We no long use Tangle, but the code still contains lot of identifiers with underscores stripped
by minux 14 Oct '11

14 Oct '11

Hi! LuaTeX stopped using tangle long time ago, but identifiers like kpseinitprog, kpsesetprogramenabled, are still in the code. They make the program a little unreadable, so I'm current working on it. I would like to hear any suggestions from you: is it necessary? Best regards, minux.

3 4

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 11 Oct '11

11 Oct '11

------------------------------------------------------------------------ r4357 | taco | 2011-10-11 14:06:13 +0200 (Tue, 11 Oct 2011) | 2 lines Changed paths: M /trunk/manual/luatexref-t.pdf M /trunk/manual/luatexref-t.tex improve description of \directlua based on a proposal by Javier A. M?\195?\186gica ------------------------------------------------------------------------

1 0

\ifincsname broken
by Heiko Oberdiek 10 Oct '11

10 Oct '11

Hello, \ifincsname behaves different from pdfTeX: \catcode`\{=1 \catcode`\}=2 \ifx\directlua\undefined \else \directlua{tex.enableprimitives('',{'ifincsname'})}% \fi \def\empty{} \edef\x{% \expandafter\noexpand\csname A\csname empty\endcsname\ifincsname A\else B\fi \endcsname } \immediate\write16{\meaning\x} \csname @@end\endcsname\end Result with pdfTeX 3.1415926-2.3-1.40.12 (TeX Live 2011): \AA Result with LuaTeX beta-0.70.1-2011061416 (rev 4277): \AB It seems that in LuaTeX the true setting of \ifincsname is cleared after the embedded \csname...\endcsname instead of restoring the previous status of \ifincsname. Yours sincerely Heiko Oberdiek

2 1

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 06 Oct '11

06 Oct '11

------------------------------------------------------------------------ r4355 | hhenkel | 2011-10-05 22:51:01 +0200 (Wed, 05 Oct 2011) | 3 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/pdf/pdfgen.w M /trunk/source/texk/web2c/luatexdir/utils/utils.w try to fix [luatex 0000725]: buglet pdfsetmatrix & rm macro clutter ------------------------------------------------------------------------ r4356 | hhenkel | 2011-10-05 23:59:13 +0200 (Wed, 05 Oct 2011) | 33 lines Changed paths: M /trunk/source/texk/web2c/Makefile.in M /trunk/source/texk/web2c/luatexdir/ChangeLog M /trunk/source/texk/web2c/luatexdir/am/libluatex.am M /trunk/source/texk/web2c/luatexdir/am/luatex.am M /trunk/source/texk/web2c/luatexdir/am/txt2zlib.am M /trunk/source/texk/web2c/luatexdir/lua/lkpselib.c M /trunk/source/texk/web2c/luatexdir/luatex.c M /trunk/source/texk/web2c/luatexdir/tex/inputstack.w M /trunk/source/texk/web2c/luatexdir/tex/printing.w M /trunk/source/texk/web2c/luatexdir/tex/stringpool.w integrate TeX-Live patches from Peter, starting from TeX-Live SVN 22701, up to SVN 24212: 2011-10-04 Peter Breitenlohner <peb(a)mppmu.mpg.de> * am/libluatex.am: Avoid to `clean' ../mplibdir/lmplib.c. * am/txt2zlib.am (noinst_PROGRAMS): Conditionally add txt2zlib, such that txt2zlib$(EXEEXT) gets cleaned. 2011-09-30 Peter Breitenlohner <peb(a)mppmu.mpg.de> * tex/printing.w (print_file_line): Bug fix: avoid uninitialized lineno - from ../tex.ch. * tex/inputstack.w: Slightly reformulate printing of current line - from ../etexdir/etex.ch. 2011-08-04 Magnus Granberg <zorry(a)gentoo.org> * luatex.c: Do not #include empty file <kpathsea/recorder.h>. 2011-06-17 Peter Breitenlohner <peb(a)mppmu.mpg.de> Reduce memory leaks. * lua/lkpselib.c (do_lua_kpathsea_lookup): Free string no longer used. 2011-06-16 Peter Breitenlohner <peb(a)mppmu.mpg.de> lua/lkpselib.c (find_dpi): Allow find_suffix() to return a const string. ------------------------------------------------------------------------

1 0

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 05 Oct '11

05 Oct '11

------------------------------------------------------------------------ r4354 | hhenkel | 2011-10-04 23:20:10 +0200 (Tue, 04 Oct 2011) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/image/pdftoepdf.cc simplify conv_double_to_pdffloat() ------------------------------------------------------------------------

1 0

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 04 Oct '11

04 Oct '11

------------------------------------------------------------------------ r4353 | hhenkel | 2011-10-04 21:00:21 +0200 (Tue, 04 Oct 2011) | 2 lines Changed paths: M /trunk/source/libs/poppler/Makefile.am M /trunk/source/libs/poppler/Makefile.in M /trunk/source/libs/poppler/poppler-0.18.0/poppler/Page.cc D /trunk/source/libs/poppler/poppler-0.18.0-PATCHES/patch-01-PDF_PARSER_ONLY poppler-0.18.0 is now pristine version, no local patches needed (for linux). ------------------------------------------------------------------------

1 0