- dev-luatex - Mailing Lists

What is the unit "nc" supposed to be?
by David Kastrup 03 Apr '07

03 Apr '07

New Cicero or what? Please consider the following: This is luaTeX, Version 3.141592-snapshot-2007040210 (Web2C 7.5.6) **\dimen0=1nc *\showthe\dimen0 > 12.80373pt. <*> \showthe\dimen0 ? *\dimen0=0.99998nc *\showthe\dimen0 > -0.09723pt. <*> \showthe\dimen0 ? * This does not cut it at all. The section in tex.web starts with @ The necessary conversion factors can all be specified exactly as fractions whose numerator and denominator are 32768 or less. In LuaTeX, the section brazenly starts with @ The necessary conversion factors can all be specified exactly as fractions whose numerator and denominator are 65535 or less. Who does things like that without actually checking that they work? It is possible to rework the arithmetic to get along with 65535, but it is certainly not a matter of merely changing the _documentation_ and not the code. I have no idea whether this is an eTeX, a PDFTeX, an Aleph or a LuaTeX invention (did I forget anything?), but it certainly can't stay like that. Sorry if I sound like a whiner here. If you think it worth the trouble, I can rework the arithmetic (but there is a reason that Knuth kept to 15 bit factors, so it is going to become more complicated). But I consider it more likely that nc should be changed to 1370:107 which is the closest 15 bit fraction to 12nd (it is smaller than 12nd, but the next larger suitable fraction 32163:2512 is slightly further from 12nd). Please remember that in TeX, 2in is not equal to 1in+1in anyway. I think we can afford this. Certainly better than the current behavior. -- David Kastrup

4 11

Rationale for using putenv?
by David Kastrup 02 Apr '07

02 Apr '07

Hi, in luastuff.c we have static int os_setenv (lua_State *L) { char *value, *key, *val; key = (char *)luaL_optstring(L, 1, NULL); val = (char *)luaL_optstring(L, 2, NULL); if (key) { if (val) { value = xmalloc(strlen(key)+strlen(val)+2); sprintf(value,"%s=%s",key,val); if (putenv(value)) { return luaL_error(L, "unable to change environment"); } } else { #if defined(WIN32) || defined(__sun__) value = xmalloc(strlen(key)+2); sprintf(value,"%s=",key); if (putenv(value)) { return luaL_error(L, "unable to change environment"); } #else (void)unsetenv(key); #endif } } lua_pushboolean (L, 1); return 1; } Now putenv is not required by Posix, as opposed to setenv. The main rationale for "putenv" is that it leaves memory management of the string to the application, and thus can avoid leaking memory. However, the above code just uses xmalloc without deallocating previously set values, so it leaks, anyway. Basically I see two ways of dealing with this: a) maintain a table of key -> "key=value" mappings for environment variables that have been set by Lua. That way, one can keep track of what strings need to stay allocated, and which can be deallocated again. b) don't bother about the leak and use setenv instead. Option b) would be somewhat more portable, I believe. Of course, if people actually use os_setenv to switch around between environment variables frequently, the leak might get annoying at some point of time. -- David Kastrup

3 10

LaTeX and LuaTeX
by David Kastrup 02 Apr '07

02 Apr '07

Well, the various LaTeX hyphenation pattern files are giving me a run for my money: authors think it is a good idea to encode them in binary, regardless of whether we are talking latin-1, T1 or koi8 encodings. What a mess. I started writing to a few of the maintainers... Anyway, in the mean time one can dump LaTeX using the following file named latex.8bit instead: That's just for dumping: I have not actually tried running this format. I don't even know whether the callback survives into the format or not... -- David Kastrup

2 3

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 02 Apr '07

02 Apr '07

U luatex/src/texk/web2c/luatexdir/lua/luainit.c Checked out revision 383.

1 0

automadness
by Taco Hoekwater 02 Apr '07

02 Apr '07

Hi, Arthur Reutenauer wrote: > > * The spurious '$' are more of a concern: apparently they're due to > discrepancies between Solaris /bin/sh and bash (which seem to > interpret constructs like > "test \"`echo '$''{'ac_cv_prog_LN_S'+set}'`\" = set" differently, > and on Solaris the dollar sign is set verbatim). So what we actually > have to do is use bash for the configure scripts (which on Solaris > is available as /bin/bash as well as /usr/bin/bash). But of course, > the path is set explicitely at the top of the script... So this is > more of a problem. > > So, as a last request, would it be possible the tell autoconf to write > "#!/bin/bash" at the beginning of the configure scripts, instead of > /bin/sh? This seems the way to go, since on many systems /bin/sh is bash > anyway (including Mac OS X), and apparently it's expected to be it, since > it doesn't work otherwise on Solaris. > > If it it's not possible, let it be; I'll find a workaround, but this is > rather silly. I agree that it is silly, but I just realized that this version will at least *run* on systems with only sh or pdksh. Changing the first line of the configure scripts to something like #!/usr/bin/env bash would make it fail completely on such systems. So, I am sorry, but I have changed my mind about making that change to the configure scripts (for now). Best wishes, Taco

3 2

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 30 Mar '07

30 Mar '07

U luatex/src/texk/kpathsea/c-memstr.h U luatex/src/texk/kpathsea/texmf.in U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/lua/luastuff.c U luatex/src/texk/web2c/luatexdir/font/ttflua.c Checked out revision 382.

1 0

Snapshot 20070322
by Taco Hoekwater 30 Mar '07

30 Mar '07

Hi all, Over the past week, I have been far too busy with the ConTeXt conference (this weekend) to get much work done, but there is a snapshot release available nevertheless. What's new: * I have changed the token_filter callback quite rigorously, mostly because of speed issues. The raw speed of trivial lua token handling is now only about 20 times slower than the native handling. Not bad at all, considering it has to move between interpreted and compiled code for each and every token. If you do not run the token filter inside \output, the effective run speed difference should not be much more than a factor 1.5. Two big differences: you have to call token.get_next() yourself, and the token table is now a three-item array instead of a five-key hash. The minimal example changes to \directlua0{ callback.register('token_filter', function () return token.get_next() end) } more details are in the manual. * I've fixed a few bugs in the handling of Opentype TTF, and added a new key in the font definition table: f.encodingbytes = (1|2) The default is 2 for opentype and truetype format, 1 otherwise. Later on, it will become possible to have a type1 font in 2-byte (CID) encoding or a truetype font in traditional encoding (1-byte), but I have not covered all cases yet. Next up: Idris found a big problem with inline RL-LR switching in PDF mode that I have to fix, TrueType-based (OpenType) subsetting, and node creation callbacks. Happy TeXing, Taco ----- Downloading and installation details: If you go to https://foundry.supelec.fr/frs/?group_id=10 you will see that there are three new released files: * luatex-snapshot-200703022.tar.bz2 This is the source tree. * luatex-snapshot-20070322-win32.zip A cross-compiled (mingw) windows binary. This is a web2c based binary, so it needs a texmf.cnf file (It will NOT work if you have only miktex installed). * luatex-snapshot-20070322-linux-i386.tar.bz2 An intel 32 linux binary (very new gcc/libc)

3 3

Utf-8 too dominant?
by David Kastrup 27 Mar '07

27 Mar '07

Hi, I just tried doing luatex -ini latex.ltx with a freshly checked out LuaTeX. The result is This is luaTeX, Version 3.141592-snapshot-2007032611 (Web2C 7.5.6) (INITEX) (/usr/local/texlive/2007/texmf-dist/tex/latex/base/latex.ltx (/usr/local/texlive/2007/texmf-dist/tex/latex/base/texsys.cfg) ./texsys.aux found \@currdir set to: ./. Assuming \openin and \input have the same search path. Defining UNIX/DOS style filename parser. catcodes, registers, compatibility for TeX 2, parameters, LaTeX2e <2005/12/01> hacks, control, par, spacing, files, font encodings, lengths, ==================================== Local config file fonttext.cfg used ==================================== (/usr/local/texlive/2007/texmf-dist/tex/cslatex/base/fonttext.cfg (/usr/local/texlive/2007/texmf-dist/tex/latex/base/omlenc.def) (/usr/local/texlive/2007/texmf-dist/tex/latex/base/t1enc.def) (/usr/local/texlive/2007/texmf-dist/tex/latex/base/ot1enc.def) (/usr/local/texlive/2007/texmf-dist/tex/latex/cslatex/il2enc.def) (/usr/local/texlive/2007/texmf-dist/tex/latex/base/omsenc.def) (/usr/local/texlive/2007/texmf-dist/tex/latex/base/t1cmr.fd) (/usr/local/texlive/2007/texmf-dist/tex/latex/base/ot1cmr.fd) (/usr/local/texlive/2007/texmf-dist/tex/latex/cslatex/il2cmr.fd) (/usr/local/texlive/2007/texmf-dist/tex/latex/base/ot1cmss.fd) (/usr/local/texlive/2007/texmf-dist/tex/latex/base/ot1cmtt.fd)) ==================================== Local config file fontmath.cfg used ==================================== (/usr/local/texlive/2007/texmf-dist/tex/latex/base/fontmath.cfg (/usr/local/texlive/2007/texmf-dist/tex/latex/base/fontmath.ltx === Don't modify this file, use a .cfg file instead === (/usr/local/texlive/2007/texmf-dist/tex/latex/base/omlcmm.fd) (/usr/local/texlive/2007/texmf-dist/tex/latex/base/omscmsy.fd) (/usr/local/texlive/2007/texmf-dist/tex/latex/base/omxcmex.fd) (/usr/local/texlive/2007/texmf-dist/tex/latex/base/ucmr.fd))) ==================================== Local config file preload.cfg used ===================================== (/usr/local/texlive/2007/texmf/tex/generic/config/preload.cfg (/usr/local/texlive/2007/texmf-dist/tex/latex/base/preload.ltx)) page nos., x-ref, environments, center, verbatim, math definitions, boxes, title, sectioning, contents, floats, footnotes, index, bibliography, output, ! Buffer contains an invalid utf-8 sequence. l.7804 \lccode`\ �=`\i % dotted I ? ! Pool contains an invalid utf-8 sequence . l.7804 \lccode`\� =`\i % dotted I ? ! Buffer contains an invalid utf-8 sequence. l.7805 \uccode`\ �=`\^^9d % dotted I ? ! Pool contains an invalid utf-8 sequence . l.7805 \uccode`\� =`\^^9d % dotted I ? ! Buffer contains an invalid utf-8 sequence. l.7805 \uccode`\�=`\ � % dotted I ? ! Pool contains an invalid utf-8 sequence [...] Now the sequences in question are: \ifnum\inputlineno=\m@ne\else \lccode`\^^9d=`\i % dotted I \uccode`\^^9d=`\^^9d % dotted I \lccode`\^^9e=`\^^9e % d-bar \uccode`\^^9e=`\^^d0 % d-bar \fi In short: the buffer does not contain any illegal utf-8 sequence at all! latex.ltx consists _solely_ of ASCII characters in the range 0-127. Instead, LuaTeX barfs on "\^^9d" and similar ASCII _transliterations_ of characters which happen to be legal _characters_ in Unicode (though not legal _bytes_ in utf-8). (/usr/local/texlive/2007/texmf-dist/tex/generic/xu-hyphen/xu-bahyph.tex ! Text line contains an invalid utf-8 sequence. l.17 \lccode`\ �=0 ? ! Text line contains an invalid utf-8 sequence. l.20 \ifnum\lccode`\ �=0 % if bahyph.tex didn't change this, ? Again, the input file is purely ASCII, in this case \begingroup \expandafter\ifx\csname XeTeXrevision\endcsname\relax \else % The standard bahyph.tex is plain ASCII, so directly readable; % but we want to add patterns for n-tilde (^^f1), as generated by % bahyph.sh if the "latin1" option is given. % However, if a "latin1" version of bahyph was already present, % these would be duplicate patterns. % We'll watch the \lccode of ^^f1 so as to detect this. \lccode`\^^f1=0 \let\PATTERNS=\patterns \def\patterns{% \ifnum\lccode`\^^f1=0 % if bahyph.tex didn't change this, \lccode`\^^f1=`\^^f1 % then we can load the extra patterns here \PATTERNS{1^^f1a 1^^f1e 1^^f1o 1^^f1i 1^^f1u}% \fi \PATTERNS } \fi So we have error messages about "pool", "buffer" and "text line" containing invalid utf-8 sequences, when the input actually is just ASCII. -- David Kastrup

6 13

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 27 Mar '07

27 Mar '07

U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/lua/ltokenlib.c Checked out revision 377.

1 0

man page for luatex
by Norbert Preining 22 Mar '07

22 Mar '07

Hi all! Not that I am a great man page writer, but I wanted to have one for Debian, so here it is, if you want to include it, improve it... Best wishes Norbert ------------------------------------------------------------------------------- Dr. Norbert Preining <preining(a)logic.at> Università di Siena Debian Developer <preining(a)debian.org> Debian TeX Group gpg DSA: 0x09C5B094 fp: 14DF 2E6C 0307 BE6D AD76 A9C0 D2BF 4AA3 09C5 B094 ------------------------------------------------------------------------------- LOWESTOFT (n.) (a) The balls of wool which collect on nice new sweaters. (b) The correct name for 'navel fluff'. --- Douglas Adams, The Meaning of Liff

1 0