- dev-luatex - NTG Mailing Lists

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 25 Aug '06

25 Aug '06

U luatex/build.sh.cross U luatex/src/texk/web2c/luatexdir/Makefile.in A luatex/src/texk/web2c/luatexdir/textcodes.c U luatex/src/texk/web2c/luatexdir/luatex.web A luatex/src/texk/web2c/luatexdir/mathcodes.c U luatex/src/texk/web2c/luatexdir/luatex.h U luatex/src/texk/web2c/luatexdir/luatex.defines Checked out revision 96.

1 0

Snapshot 20060825
by Taco Hoekwater 25 Aug '06

25 Aug '06

Hi all, I have released a new snapshot just a few moments ago. The main change in this snapshot is that it uses far less memory. luatex -ini on my linux machine went from 326Mb (last week) to 93Mb (now), and "texexec luatex" now ends at 184Mb instead of over 1/2Gb. This is achieved by two big changes: * The \mathcode, \delcode, \catcode, \sfcode, \lccode and \uccode tables are now sparse arrays that are implemented in C. They are no longer part of the TeX "equivalence table" and because each had 1.1 million entries with a few memory words each, this makes a major difference. See mathcodes.c and textcodes.c if you are interested in the gory details, but be warned: the code is still extremely rough and ugly. In particular, the dump and undump routines are far from optimal, resulting in somewhat larger format files than before (approx 1.3Mb larger with unicode-letters loaded, 10k without); and the assignments do not show up when using the etex tracing routines \tracingassigns and \tracingrestores (code simply not written yet) * Single-character commands are no longer "special" internally, they are stored in the hash just like the multiletter csnames. Both changes are supposed to be transparent to the user, so if something does not work _exactly_ as before, it is a bug. There are a few memory hogs remaining (active characters and the various registers), but I will not dive into those until (much) later. Next week I will focus on the input callbacks, so that files no longer have to be utf-8 encoded. ------------------- Downloading and installation details: If you go to https://foundry.supelec.fr/frs/?group_id=10&release_id=164 you will see that there are three released files: * luatex-snapshot-20060825.tar.gz This is the source tree. * luatex-snapshot-20060825-win32.zip A cross-compiled (mingw) windows binary. This is a web2c based binary, so it needs a texmf.cnf file (It will NOT work if you have only miktex installed). This executable cannot run dynamically loaded lua dlls. Perhaps that can be fixed but I do not know how. * luatex-snapshot-20060825-linux-i386.tar.gz A linux binary. This needs ld-linux.so.2, so you need a somewhat modern linux for that, but compiling from source for linux should not be a problem. The binaries should go in a 'normal' TeX binary folder like texmf/bin or texmf-win32/bin so that they can find your texmf.cnf automatically. If you put them elsewhere, you have to set the TEXMFCNF environment variable. There is no pool file, so you do not have to worry about that. For meaningful unicode input and hyphenation, you need a file that sets the \lccode etc. values for chars with a value higher than 256. One such file is part of the xetex distribution (unicode-letters.tex). Greetings, Taco

1 0

bug
by Hans Hagen 22 Aug '06

22 Aug '06

Hi Taco, As we discussed by chat ... there is a buffer overflow when the amount of chars fed into lua is large: Error: luatex.exe: buffer overflow at file ../../../../src/texk/web2c/luatexdir /utils.c, line 177 Low priority bug since it was an extreme case. Hans ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com | www.pragma-pod.nl -----------------------------------------------------------------

1 0

Snapshot 20060818 released
by Taco Hoekwater 19 Aug '06

19 Aug '06

Hi all, I have made a first snapshot available, now that it processes torture.tex correctly. This is not a 'release' per se, so please do not be offended by the extreme lack of install instructions and manual. Some hints are at the end of this message. The snapshot is up to par with Aleph-RC4 (from texlive devel) and the latest pdftex beta (even newer than 20060811). However, there are some differences, to summarize: * There is no pool file (all strings are embedded) * -8bit and -translate-file are silently ignored * There is no mltex nor enctex (conflicts with aleph) * The tex functionality is always present and enabled (but see below about TeXXeT), so the asterisk or -etex switch for initex is not needed * "plus 1 filllllllll" does not generate any errors from TeX * TeXXeT (from eTeX) is not present, so the primives \TeXXeTstate \beginR \beginL \endR \endL are missing * The experimental pdftex regex match operations are removed, because that feature does not make much sense when lua is available so the primitives \pdfmatch \pdflastmatch are missing * The input translations from Aleph are not implemented, the 16 related primitives are all missing \DefaultInputMode \noDefaultInputMode \noInputMode \InputMode \DefaultOutputMode \noDefaultOutputMode \noOutputMode \OutputMode \DefaultInputTranslation \noDefaultInputTranslation \noInputTranslation \InputTranslation \DefaultOutputTranslation \noDefaultOutputTranslation \noOutputTranslation \OutputTranslation All file IO assumes UTF-8, except that all the low-ascii controls except TAB, CR en LF are written to the terminal using ^^ notation (even these are binary in the log file). * Input characters can use the full range of Unicode, but it probably only makes sense to use values above the base plane for \mathcode and \catcode assignments, since the fonts as well as the hyphenation patterns are strictly 16-bit still. * The primitives \pdfpagewidth and \pagewidth, \pdfpageheight and \pageheight, \fontcharwd and \charwd, \fontcharht and \charht, \fontchardp and \chardp, \fontcharic and \charic, are all aliases of eachother. * The new primitive \clearmarks<number> clears a marks class completely. * The experimental pdftex primitives \pdfprimitive \ifpdfprimitive \ifpdfabsnum \ifpdfabsdim and provided without the extra 'pdf' prefix, so they are simply called \primitive \ifprimitive \ifabsnum \ifabsdim instead. * I probably forgot to mention some things :-) Have fun, Taco Downloading and installation details: If you go to https://foundry.supelec.fr/frs/?group_id=10&release_id=160 you will see that there are three released files: * luatex-snapshot-20060818.tar.gz This is the source tree. * luatex-snapshot-20060818-win32.zip A cross-compiled (mingw) windows binary. This is a web2c based binary, so it needs a texmf.cnf file (It will NOT work if you have only miktex installed). This executable cannot run dynamically loaded lua dlls. Perhaps that can be fixed but I do not know how. * luatex-snapshot-20060818-linux-i386.tar.gz A linux binary. This needs ld-linux.so.2, so you need a somewhat modern linux for that, but compiling from source for linux should not be a problem. The binaries should go in a 'normal' TeX binary folder like texmf/bin or texmf-win32/bin so that they can find your texmf.cnf automatically. If you put them elsewhere, you have to set the TEXMFCNF environment variable. There is no pool file, so you do not have to worry about that. For meaningful unicode input and hyphenation, you need a file that sets the \lccode etc. values for chars with a value higher than 256. One such file is part of the xetex distribution (unicode-letters.tex). Greetings, Taco

5 9

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 18 Aug '06

18 Aug '06

D luatex/pdftex.xml D luatex/NEWS D luatex/README U luatex/INSTALL U luatex/src/texk/web2c/luatexdir/utils.c U luatex/src/texk/web2c/luatexdir/luatex.ch U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/luatex.c U luatex/src/texk/web2c/luatexdir/luatex.h U luatex/src/texk/web2c/luatexdir/luatex.defines A luatex/README.luatex Checked out revision 93.

1 0

Input and output character sets
by Taco Hoekwater 17 Aug '06

17 Aug '06

Hi all (Idris especially), When you read the Omega 1.12 documentation, section 12 is all about Input and Output text file encodings and how Omega deals with those in a much more elaborate way than traditional TeX. In particular, there are "modes" and "translations", along with a number of (mixed case, yuk) primitives. I would like very much to have a smalll but complete set of test files to make sure that my merge of the Aleph code into LuaTeX is correct. Because the I/O internals are quite different, I have a hard time making sure LuaTeX behaves just like Aleph. Idris, could you (or perhaps another Aleph user) create such a set of test files? Something like a mini-trip test for just this bit of code. Thanks in advance, Taco

3 4

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 16 Aug '06

16 Aug '06

U luatex/build.sh.cross U luatex/build.sh.linux Checked out revision 90.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 16 Aug '06

16 Aug '06

D luatex/src/libs/obsdcompat/pwd.h D luatex/src/libs/obsdcompat/strmode.c U luatex/src/libs/obsdcompat/configure U luatex/src/libs/obsdcompat/Makefile.in U luatex/src/libs/obsdcompat/includes.h U luatex/src/libs/obsdcompat/config.h.in U luatex/src/libs/obsdcompat/openbsd-compat.h U luatex/src/libs/obsdcompat/configure.ac Checked out revision 89.

1 0

(no subject)
by Christof Schardt 15 Aug '06

15 Aug '06

Hello, I couldn't figure out, how I can get access to the luatex-sources. My concern is: I'm developing a music-score language, as of now called "emil" (= easy music input language), which is likely to move towards Lua. (Hans: we had a short conversation in Darmstadt, if you remember). I am curious to see, how luatex communicates with the tex-interpreter. I'm at the beginning and my first problem is, to get Lua-output as a scannable string back to the calling interpreter. Hans' luatex-manual points out, that luatex has this already built in. So my question: can I get access to the sources, or get a hint, how to output Lua to the calling interpreter, Thanks in advance Christof

3 2

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 15 Aug '06

15 Aug '06

U luatex/build.sh.cross U luatex/src/configure U luatex/src/Makefile.in U luatex/src/configure.in U luatex/src/libs/configure U luatex/src/libs/configure.in A luatex/src/libs/obsdcompat/pwd.h U luatex/src/libs/obsdcompat/includes.h U luatex/src/libs/obsdcompat/strmode.c U luatex/src/texk/web2c/configure U luatex/src/texk/web2c/Makefile.in U luatex/src/texk/web2c/luatexdir/utils.c U luatex/src/texk/web2c/luatexdir/Makefile.in U luatex/src/texk/web2c/luatexdir/ttf2afm.c U luatex/src/texk/web2c/luatexdir/luatex.ch U luatex/src/texk/web2c/luatexdir/mapfile.c U luatex/src/texk/web2c/luatexdir/writeenc.c U luatex/src/texk/web2c/luatexdir/epdf.h U luatex/src/texk/web2c/luatexdir/depend.mk U luatex/src/texk/web2c/luatexdir/luatex.mk A luatex/src/texk/web2c/luatexdir/tounicode.c U luatex/src/texk/web2c/luatexdir/NEWS U luatex/src/texk/web2c/luatexdir/writejpg.c U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/writepng.c U luatex/src/texk/web2c/luatexdir/writet1.c U luatex/src/texk/web2c/luatexdir/writet3.c U luatex/src/texk/web2c/luatexdir/writettf.c U luatex/src/texk/web2c/luatexdir/README U luatex/src/texk/web2c/luatexdir/ptexlib.h U luatex/src/texk/web2c/luatexdir/writettf.h U luatex/src/texk/web2c/luatexdir/pdftoepdf.cc U luatex/src/texk/web2c/luatexdir/luatexlib.mk U luatex/src/texk/web2c/luatexdir/subfont.c U luatex/src/texk/web2c/luatexdir/writefont.c U luatex/src/texk/web2c/luatexdir/writeimg.c U luatex/src/texk/web2c/luatexdir/luatex.defines U luatex/src/texk/web2c/lib/texmfmp.c U luatex/src/texk/web2c/lib/openclose.c Checked out revision 88.

1 0