April 2007 - dev-luatex - NTG Mailing Lists

Snapshot 20070307
by Taco Hoekwater 10 May '12

10 May '12

Hi all, I decided to do a snapshot now instead of waiting for friday, because I want to start concentrating on something else besides font support issues. What's new: * Non-CID PostScript-based Opentype fonts are now combined over the entire document, and properly subsetted. The code is borrowed from xdvipdfmx with some minor adjustments Adding support for CID-keyed OpenType fonts would not be hard but at the moment I lack example input (and incentive). * A small extension to the virtual fonts structure: you can use f.fonts[1] = { 'id' = 38} to do a backreference to a previously defined font. This saves quite a few computations * There was a bug in the handling of \leaders in the output whereby it's width was taken to be twice what it should be while writing to the PDF, fixed now. * The font inclusion code is cleaned up a bit by Hartmut. * Some compilation problems were fixed. * There is (quite a bit of) debugging information printed out when OTPs are in use, because I am tracking down a bug reported by Idris. The input of each and every OTP step is shown on the terminal in a line line this: [57902][1568][58423][1568][58408][1568][58921] those are the decimal values of ocp i/o characters. If you don't need them, don't worry about it. Happy TeXing, Taco ----- Downloading and installation details: If you go to https://foundry.supelec.fr/frs/?group_id=10 you will see that there are three new released files: * luatex-snapshot-20070307.tar.bz2 This is the source tree. * luatex-snapshot-20070307-win32.zip A cross-compiled (mingw) windows binary. This is a web2c based binary, so it needs a texmf.cnf file (It will NOT work if you have only miktex installed). * luatex-snapshot-20070307-linux-i386.tar.bz2 An intel 32 linux binary (2.6.17)

3 2

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 26 Apr '07

26 Apr '07

U luatex/src/texk/web2c/luatexdir/luatex.web Checked out revision 431.

1 0

Snapshot 20070426
by Taco Hoekwater 26 Apr '07

26 Apr '07

Hi all, This past month I have been busy with nodes and lists of nodes, so the big new feature in this release is that there are four callbacks that operate on node lists: buildpage_filter pre_linebreak_filter hpack_filter vpack_filter The preliminary documentation for these is in the manual, but the basic idea is that you can filter a node list just before LuaTeX starts doing something with it (like line breaking). This functionality is not stable yet: the node presentation of the various node types is pretty much OK now, but keep in mind the following: * math noads and math typesetting are not handled at all (yet) * not all hpacks and vpacks are intercepted (yet) * the nested node list handling will probably change * A conversion tool for nodes to/from dictionaries is planned, but not done yet The other changes in this snapshot are various bugfixes (for builds on various platforms as well as font issues) and speedups (in the execution of callbacks and the creation of lua font representations). Have fun, Taco ----- Downloading and installation details: If you go to https://foundry.supelec.fr/frs/?group_id=10 you will see that there are three new released files: * luatex-snapshot-20070426.tar.bz2 This is the source tree. * luatex-snapshot-20070426-win32.zip A cross-compiled (mingw) windows binary. This is a web2c based binary, so it needs a texmf.cnf file (It will NOT work if you have only miktex installed). * luatex-snapshot-20070426-linux-i386.tar.bz2 An intel 32 linux binary (very new gcc/libc)

2 1

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 26 Apr '07

26 Apr '07

U luatex/src/texk/web2c/luatexdir/lua/nodes.h U luatex/src/texk/web2c/luatexdir/lua/luanode.c U luatex/manual/luatexref-t.tex U luatex/manual/luatexref-t.pdf Checked out revision 430.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 25 Apr '07

25 Apr '07

U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/lua/lcallbacklib.c U luatex/src/texk/web2c/luatexdir/lua/luawhatsits.c U luatex/src/texk/web2c/luatexdir/lua/nodes.h U luatex/src/texk/web2c/luatexdir/lua/luanode.c U luatex/src/texk/web2c/luatexdir/luatex.h U luatex/src/texk/web2c/luatexdir/luatex.defines Checked out revision 427.

1 0

valid Unicode character treatment?
by David Kastrup 24 Apr '07

24 Apr '07

Hi, I've been wondering about several things with regard to Unicode/utf-8. What is the situation in fonts (of any type) in general concerning the non-existing Unicode codepoints corresponding to the 16-bit surrogate codes D800-DFFF? Are there any fonts actually putting stuff there, if only ligatures? A compliant utf-8 file is not supposed to contain any codes in that area, so we would not want to have them appear as part of "overfull hbox" messages and similar if I am not mistaken. I am currently thinking about a utf-8 strategy that would be least prone to causing internal inconsistencies: basically I think that certain properties of _legal_ utf-8 should be guaranteed inside of LuaTeX, like that the number of characters in a string being equal to the number of bytes outside of the 80-BF code range, that characters are encoded with minimal length, that the number of bytes never exceeds 4 times the number of characters and similar things. I'd tend to move the special "output in byte-sized chunks" characters to "11xxxx: after all, fonts may contain stuff in the "10ffxx area, and overfull box messages will output those characters. Those can be represented internally by (basically out of range) utf-8 sequences in the obvious way. If the input reader for utf-8 cranks out the corresponding "output in byte-sized chunks" characters for illegal utf-8 byte sequences, then inputting them accidentally will usually lead to "missing character" errors, but it will be possible to write stuff like \message{^^11xxxx} to produce verbatim output, and \message{illegal byte sequence} will reproduce the illegal byte sequence unchanged, without having any illegal byte sequence (apart from the codes for "11xxxx) present in the innards of LuaTeX. I'd think it reasonable not to permit those characters "11xxxx into the normal character arrays (lccode, uccode, chardef ...) in a manner similar to how the codes from "80 to "ff were treated in TeX-2.x (which had 7-bit arrays inside, but accepted 256 characters in fonts and input). When I write "11xxxx instead of "1100xx it is because I don't yet have a clear idea about whether or how one would bother thinking about transparent word output when using UCS-16 (which has surrogate characters and stuff). Possibly one should just completely forget about facilitating UCS-16 output, whether through callbacks or otherwise. Ok, this is just a sketch (I consider the prospect disturbing of having to code without being able to rely internally on legal utf-8 sequences as long as possibly involved callbacks are bugfree), but the main question of this posting was what how surrogate code points are treated in fonts. Thanks, David -- David Kastrup

2 2

few font setup related questions
by Igor Khomyakov 24 Apr '07

24 Apr '07

Hi All, I hope this is the right mailing list. I am trying to typeset a multilingual document with LuaTeX in pdftex mode (pdfoutput=1). The document contains english, russian and japanese texts (UTF-8 encoding). Does LuaTeX support large True Type and/or Open Type fonts? What is the best way to set these fonts up with LuaTeX ? Can they be set up "directly", or via virtual font (OVF) ? Does one need to write any Lua code in order to achieve this? Are there any samples available ? Would appreciate any pointers. Kind regards, Igor Khomyakov

2 6

\input does not look at open_read_file callback?
by David Kastrup 24 Apr '07

24 Apr '07

Hi, in the following code, the callback is never reached when called with luatex -ini bug -- David Kastrup

3 4

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 23 Apr '07

23 Apr '07

U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/lua/lstatslib.c U luatex/src/texk/web2c/luatexdir/font/ttflua.c Checked out revision 424.

1 0

Three fixes
by David Kastrup 23 Apr '07

23 Apr '07

Hi, here is a patch to luatex.web. The first hunk fixes the FSF's address to the current one, the second one makes detection of illegal utf-8 sequences slightly more attentive (though I actually would prefer a different approach), the third fixes a typo in the comment for the nc/nd patch. -- David Kastrup

2 1