- dev-luatex - NTG Mailing Lists

unicode, i/o and math
by Taco Hoekwater 31 May '06

31 May '06

Hi, I have not added anything interesting to the luatex repository today, I am working on unicode support offline but will not do any commits until I can make it stop segfaulting (later this week, hopefully). You 'll be happy to know that I have created a brand new executable: luatangle This altered version of (o)tangle writes string-ids starting from twomillionninetyseventhousandonehundredandfiftytwo (2^21). It follows that the legal range of \char arguments will become 0..(2^21-1), thus allowing for all of Unicode and some spare space (2^21-1 == 0x1FFFFF; unicode only goes up to 0x10FFFF, so there will be room for almost a million non-unicode characters). As far as the core TeX-like program is concerned, all file i/o will be done in utf-8 (with one small exception: printing of the low control bytes to the terminal will use ^^X notation for dangerous byte values like ^^D and ^^Z. The internal printing code for log and terminal will be split to allow this). User-level configuration of i/o re-encoding will nevertheless still be possible, through lua callbacks that can hook directly into the i/o subroutines. No more translate-files, no more enctex, no more 8bit switches. This is all rather straightforward, because \char, \catcode, \lccode \uccode, etc. are all 'singular values'. But the math commands need attention as well. Ofte, these are a single number representing a combination of <type>+<family>+ <charnum>, and with 21bits for the <charnum> part alone, this syntax is problematic. I propose to keep the old ones (with their old, limited syntax), but also create new primitives with names like \luamathchar etc. These will read _separate_ integers, so it will look like (e.g.) \luamathchardef\dagger = 2 0 "2020 % unicode: 2020 DAGGER \def\langle{\luadelimiter 5 2 "69 3 "0B } does that make sense to you? (comments are very welcome) Greetings, Taco

2 3

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 30 May '06

30 May '06

D luatex/src/texk/web2c/luatexdir/tex.ch0 D luatex/src/texk/web2c/luatexdir/web2c.ch D luatex/src/texk/web2c/luatexdir/lua.ch U luatex/src/texk/web2c/luatexdir/luatex.ch U luatex/src/texk/web2c/luatexdir/luatex.mk U luatex/src/texk/web2c/luatexdir/luatex.web Checked out revision 51.

2 1

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 29 May '06

29 May '06

U luatex/src/texk/web2c/luatexdir/web2c.ch Checked out revision 49.

2 1

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 26 May '06

26 May '06

U luatex/src/texk/web2c/luatexdir/luatexlib.mk Checked out revision 48.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 26 May '06

26 May '06

A luatex/src/libs/slnunicode-0.9.1 A luatex/src/libs/slnunicode-0.9.1/slnunico.c A luatex/src/libs/slnunicode-0.9.1/unitest A luatex/src/libs/slnunicode-0.9.1/slnudata.c U luatex/src/libs/lua51/Makefile U luatex/src/texk/web2c/luatexdir/luatex.mk U luatex/src/texk/web2c/luatexdir/luastuff.c U luatex/src/texk/web2c/luatexdir/luatexlib.mk U luatex/src/texk/web2c/luatexdir/luatex-api.h Checked out revision 47.

1 0

lua library support
by Taco Hoekwater 26 May '06

26 May '06

Hi, I've committed a new version. This one has slnunicode embedded and enabled, so this should work: \directlua0{ dofile("unitest") } % file is in slnunicode dir Also, the luatex binary now exports its symbol table and links with -ldl, so dynamic lua require's should also work: \directlua0{ require "zip" % you need to have zip.so zfile = zip.open("cont-tmf.zip") for i,v in zfile:files() do tex.print (i.filename) end zfile:close() } For fp: sorry, even more linux-specific stuff in the makefiles. This code is far from finished, I am just playing around trying to figure out how to set it all up in a clean manner. Cheers, Taco

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 26 May '06

26 May '06

U luatex/src/texk/web2c/luatexdir/luastuff.c Checked out revision 44.

1 0

multiple interpreters
by Taco Hoekwater 26 May '06

26 May '06

Hi, In a moment or so, I will upload a new version that can have multiple lua interpreters. My current syntax is extremely minimal: \lua<int>{<lua stuff>} \latelua<int>{<lua stuff>} So, just like before but with an extra integer, just like the \marks syntax. Non-existing interpreters are auto-initialized. There is no provision (yet?) to "clean up" an interpreter. WDYT? Taco

2 4

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 26 May '06

26 May '06

U luatex/src/texk/web2c/luatexdir/luastuff.c U luatex/src/texk/web2c/luatexdir/lua.ch U luatex/src/texk/web2c/luatexdir/luatex.defines Checked out revision 43.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 25 May '06

25 May '06

U luatex/src/texk/web2c/luatexdir/lua.ch Checked out revision 42.

1 0