- dev-luatex - NTG Mailing Lists

Snapshot 20070309
by Taco Hoekwater 20 Mar '07

20 Mar '07

Hi all, I just released a snapshot with a fun (but not yet complete) new feature you may want to play with. What's new: * The OCP debug information is removed again. * There is a new callback that I am quite excited about myself: 'token_filter'. A bit of text from the reference manual: -------------------- This callback allows you to change the modify any lexical token that enters the \type{main_control} function before \LUATEX\ executes the associated command. Note: not all tokens can be intercepted yet, only those that are `seen' by \LUATEX's main control function. Supplemental tokens like the bodies of macro definitions and the right-hand side of register assignments are not seen. For now, this is intentional. \startfunctioncall function (table <token>) return table <token> end \stopfunctioncall Calling convention for this callback is bit more complicated then for most other callbacks. Initially, lua function will be called with the next token from \type{get_next()} as argument, represented as a small lua table. The function should either return a lua table representing a valid to-be-processed token, or something else like nil or an empty table. If your lua function does not return a table representing a valid token, it will be immediately called again with yet another token from \type{get_next()} as argument, until it eventually does return a useful token. But if the function does return a usable token, then that token will be processed by \LUATEX. Afterwards, the function will be called again, but now without an argument. This is repeated until it stops returning tokens. Then processing reverts back to the other branch. The point behind that roundabout calling convention is that it allows the lua function to buffer tokens for various uses. That in turn makes it possible to do some really advanced things like replacing OTPs. Now about that table. The table that the function will receive contains four fields: \starttabulate[|l|i|p|] \NC Key \NC type \NC Explanation \NC\FR \NC cmd \NC string \NC A representation of \LUATEX's internal command code\NC\NR \NC chr \NC number \NC The command code modifier\NC\NR \NC cs \NC string \NC If the token came from a csname, this is that csname\NC\NR \NC mod \NC character \NC A single character string representing the current processing mode. One of {\bf v}ertical, {\bf h}orizontal, display {\bf m}ath, {\bf n}o, internal {\bf V}ertical, restricted {\bf H}orizontal, or inline {\bf M}ath mode.\NC\LR \stoptabulate If you modify the table before returning it, then it is wise to return either a (\type{cmd}, \type{chr}) pair, or a \type{cs} string. That is because if both options are present, the pair has precedence and the string is ignored. On the return table, {\bf mod} is ignored always. -------------- I have no long example code yet and it is not as complete as one would want it to be because it is not intercepting everything that comes in, only the bits that are triggered by the main control loop. I decided to do a fast snapshot release for two reasons: * It is one of the easier extensions to get started with if you want to learn a bit about lua programming * I would welcome feedback on the token interface, because it will be needed in other places as well, soon. I am still not sure whether converting the command to/from strings is worth it, for example. And maybe it would be less confusing if you could return a list of tokens instead of being called repeatedly? Here is the trivial example to get you started: \directlua0{ callback.register('token_filter', function (t) return t end) } Happy TeXing, Taco ----- Downloading and installation details: If you go to https://foundry.supelec.fr/frs/?group_id=10 you will see that there are three new released files: * luatex-snapshot-20070309.tar.bz2 This is the source tree. * luatex-snapshot-20070309-win32.zip A cross-compiled (mingw) windows binary. This is a web2c based binary, so it needs a texmf.cnf file (It will NOT work if you have only miktex installed). * luatex-snapshot-20070309-linux-i386.tar.bz2 An intel 32 linux binary (2.6.17)

2 1

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 16 Mar '07

16 Mar '07

U luatex/src/libs/lua51/Makefile U luatex/src/texk/web2c/luatexdir/lua/lcallbacklib.c U luatex/src/texk/web2c/luatexdir/lua/luatoken.c U luatex/src/texk/web2c/luatexdir/lua/ltexlib.c U luatex/src/texk/web2c/luatexdir/lua/ltokenlib.c U luatex/src/texk/web2c/luatexdir/font/ttflua.c U luatex/src/texk/web2c/luatexdir/font/writecff.c U luatex/src/texk/web2c/luatexdir/font/dofont.c U luatex/src/texk/web2c/luatexdir/font/luafont.c U luatex/src/texk/web2c/luatexdir/font/texfont.c Checked out revision 374.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 15 Mar '07

15 Mar '07

U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/font/luafont.c U luatex/src/texk/web2c/luatexdir/font/writefont.c U luatex/src/texk/web2c/luatexdir/font/vfovf.c U luatex/src/texk/web2c/luatexdir/font/texfont.c U luatex/src/texk/web2c/luatexdir/font/texfont.h U luatex/src/texk/web2c/luatexdir/luatex.defines Checked out revision 372.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 15 Mar '07

15 Mar '07

U luatex/src/texk/web2c/luatexdir/utils.c U luatex/src/texk/web2c/luatexdir/Makefile.in U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/lua/ltexlib.c A luatex/src/texk/web2c/luatexdir/lua/ltokenlib.c U luatex/src/texk/web2c/luatexdir/lua/luainit.c U luatex/src/texk/web2c/luatexdir/lua/luastuff.c U luatex/src/texk/web2c/luatexdir/font/ttflua.c U luatex/manual/luatexref-t.tex Checked out revision 368.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 14 Mar '07

14 Mar '07

U luatex/src/texk/web2c/luatexdir/utils.c U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/lua/lcallbacklib.c U luatex/src/texk/web2c/luatexdir/lua/luatoken.c U luatex/src/texk/web2c/luatexdir/lua/ltexlib.c U luatex/src/texk/web2c/luatexdir/luatex-api.h U luatex/src/texk/web2c/luatexdir/luatex.defines Checked out revision 366.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 09 Mar '07

09 Mar '07

U luatex/src/texk/web2c/luatexdir/utils.c U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/lua/luatoken.c U luatex/manual/luatexref-t.tex U luatex/manual/luatexref-t.pdf Checked out revision 363.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 08 Mar '07

08 Mar '07

U luatex/src/texk/web2c/luatexdir/Makefile.in U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/lua/lcallbacklib.c A luatex/src/texk/web2c/luatexdir/lua/luatoken.c U luatex/src/texk/web2c/luatexdir/luatex.defines Checked out revision 358.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 07 Mar '07

07 Mar '07

U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/font/writefont.c U luatex/src/texk/web2c/luatexdir/font/texfont.c U luatex/manual/luatexref-t.tex U luatex/manual/luatexref-t.pdf Checked out revision 357.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 07 Mar '07

07 Mar '07

U luatex/src/texk/web2c/luatexdir/luatex.web Checked out revision 355.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 06 Mar '07

06 Mar '07

U luatex/src/texk/web2c/luatexdir/font/writecff.c U luatex/src/texk/web2c/luatexdir/font/texfont.c Checked out revision 354.

1 0