- dev-luatex - NTG Mailing Lists

font encodings in luatex
by Mojca Miklavec 06 May '07

06 May '07

Hello Hans, I need to figure out where things start going wrong, but the following code: \mainlanguage[sl] \definefontsynonym[bla][ec-lmbx12][encoding=ec] \definedfont[bla] \quotation{ščurek}. Results in żurekń (two characters eaten and the other two come from the wrong place). It would be nice if the problem would be fixed (it breaks old documents), but I don't claim that it should be (in XeTeX it is not). Mojca

2 1

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 06 May '07

06 May '07

svn: PROPFIND request failed on '/svn/luatex' svn: PROPFIND of '/svn/luatex': Could not resolve hostname `scm.foundry.supelec.fr': Temporary failure in name resolution (https://scm.foundry.supelec.fr)

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 26 Apr '07

26 Apr '07

U luatex/src/texk/web2c/luatexdir/luatex.web Checked out revision 431.

1 0

Snapshot 20070426
by Taco Hoekwater 26 Apr '07

26 Apr '07

Hi all, This past month I have been busy with nodes and lists of nodes, so the big new feature in this release is that there are four callbacks that operate on node lists: buildpage_filter pre_linebreak_filter hpack_filter vpack_filter The preliminary documentation for these is in the manual, but the basic idea is that you can filter a node list just before LuaTeX starts doing something with it (like line breaking). This functionality is not stable yet: the node presentation of the various node types is pretty much OK now, but keep in mind the following: * math noads and math typesetting are not handled at all (yet) * not all hpacks and vpacks are intercepted (yet) * the nested node list handling will probably change * A conversion tool for nodes to/from dictionaries is planned, but not done yet The other changes in this snapshot are various bugfixes (for builds on various platforms as well as font issues) and speedups (in the execution of callbacks and the creation of lua font representations). Have fun, Taco ----- Downloading and installation details: If you go to https://foundry.supelec.fr/frs/?group_id=10 you will see that there are three new released files: * luatex-snapshot-20070426.tar.bz2 This is the source tree. * luatex-snapshot-20070426-win32.zip A cross-compiled (mingw) windows binary. This is a web2c based binary, so it needs a texmf.cnf file (It will NOT work if you have only miktex installed). * luatex-snapshot-20070426-linux-i386.tar.bz2 An intel 32 linux binary (very new gcc/libc)

2 1

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 26 Apr '07

26 Apr '07

U luatex/src/texk/web2c/luatexdir/lua/nodes.h U luatex/src/texk/web2c/luatexdir/lua/luanode.c U luatex/manual/luatexref-t.tex U luatex/manual/luatexref-t.pdf Checked out revision 430.

1 0

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 25 Apr '07

25 Apr '07

U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/lua/lcallbacklib.c U luatex/src/texk/web2c/luatexdir/lua/luawhatsits.c U luatex/src/texk/web2c/luatexdir/lua/nodes.h U luatex/src/texk/web2c/luatexdir/lua/luanode.c U luatex/src/texk/web2c/luatexdir/luatex.h U luatex/src/texk/web2c/luatexdir/luatex.defines Checked out revision 427.

1 0

valid Unicode character treatment?
by David Kastrup 24 Apr '07

24 Apr '07

Hi, I've been wondering about several things with regard to Unicode/utf-8. What is the situation in fonts (of any type) in general concerning the non-existing Unicode codepoints corresponding to the 16-bit surrogate codes D800-DFFF? Are there any fonts actually putting stuff there, if only ligatures? A compliant utf-8 file is not supposed to contain any codes in that area, so we would not want to have them appear as part of "overfull hbox" messages and similar if I am not mistaken. I am currently thinking about a utf-8 strategy that would be least prone to causing internal inconsistencies: basically I think that certain properties of _legal_ utf-8 should be guaranteed inside of LuaTeX, like that the number of characters in a string being equal to the number of bytes outside of the 80-BF code range, that characters are encoded with minimal length, that the number of bytes never exceeds 4 times the number of characters and similar things. I'd tend to move the special "output in byte-sized chunks" characters to "11xxxx: after all, fonts may contain stuff in the "10ffxx area, and overfull box messages will output those characters. Those can be represented internally by (basically out of range) utf-8 sequences in the obvious way. If the input reader for utf-8 cranks out the corresponding "output in byte-sized chunks" characters for illegal utf-8 byte sequences, then inputting them accidentally will usually lead to "missing character" errors, but it will be possible to write stuff like \message{^^11xxxx} to produce verbatim output, and \message{illegal byte sequence} will reproduce the illegal byte sequence unchanged, without having any illegal byte sequence (apart from the codes for "11xxxx) present in the innards of LuaTeX. I'd think it reasonable not to permit those characters "11xxxx into the normal character arrays (lccode, uccode, chardef ...) in a manner similar to how the codes from "80 to "ff were treated in TeX-2.x (which had 7-bit arrays inside, but accepted 256 characters in fonts and input). When I write "11xxxx instead of "1100xx it is because I don't yet have a clear idea about whether or how one would bother thinking about transparent word output when using UCS-16 (which has surrogate characters and stuff). Possibly one should just completely forget about facilitating UCS-16 output, whether through callbacks or otherwise. Ok, this is just a sketch (I consider the prospect disturbing of having to code without being able to rely internally on legal utf-8 sequences as long as possibly involved callbacks are bugfree), but the main question of this posting was what how surrogate code points are treated in fonts. Thanks, David -- David Kastrup

2 2

few font setup related questions
by Igor Khomyakov 24 Apr '07

24 Apr '07

Hi All, I hope this is the right mailing list. I am trying to typeset a multilingual document with LuaTeX in pdftex mode (pdfoutput=1). The document contains english, russian and japanese texts (UTF-8 encoding). Does LuaTeX support large True Type and/or Open Type fonts? What is the best way to set these fonts up with LuaTeX ? Can they be set up "directly", or via virtual font (OVF) ? Does one need to write any Lua code in order to achieve this? Are there any samples available ? Would appreciate any pointers. Kind regards, Igor Khomyakov

2 6

\input does not look at open_read_file callback?
by David Kastrup 24 Apr '07

24 Apr '07

Hi, in the following code, the callback is never reached when called with luatex -ini bug -- David Kastrup

3 4

Cron <luatex@server> /home/luatex/luatex-svn
by root＠aanhet.net 23 Apr '07

23 Apr '07

U luatex/src/texk/web2c/luatexdir/luatex.web U luatex/src/texk/web2c/luatexdir/lua/lstatslib.c U luatex/src/texk/web2c/luatexdir/font/ttflua.c Checked out revision 424.

1 0