dev-luatex December 2022

dev-luatex@ntg.nl

5 participants
6 discussions

Luatex 1.12.0 announcement.
by luigi scarso 27 May '23

27 May '23

============================================================== LuaTeX 1.12.0 2020-03-15 ============================================================== This is the release for TeX live 2020. --shell-restricted now forbids loading of dso (dll/so object) Scaled virtual font Aadditional primitives \eTeXglue[stretch|shrink]order for querying order the etex way. Extra features runtoks tex.getmodenames() (as these can differ per engine/version) Permit nested runtoks in more complex situations of nesting (HH) More accurate and correct test for tex.[set|get]math Minor clean-up and bugs fixed -- luigi

4 8

Fix for pdf_literal Lua string / token list conversions
by Michal Vlasák 06 May '23

06 May '23

Hello, take this plain LuaTeX example: \setbox0=\hbox{\pdfextension literal{0 g}} % 1) \directlua{ local literal = tex.getbox(0).head texio.write_nl("log", "literal.data="..literal.data) } \showbox0 % 2) \directlua{ local literal = tex.getbox(0).head literal.data = "test" literal.token = "toks" texio.write_nl("log", "literal.token="..(literal.token or "nil")) } \showbox0 % 3) patch test \directlua{ tex.set("everyjob", "asd") texio.write_nl("log", tex.get("everyjob")) } \bye Expected log output (abridged): 1) literal.data=0 g .\pdfliteral origin{0 g} 2) literal.token=toks .\pdfliteral origin{toks} Actual output: 1) literal.data=data .\pdfliteral origin{0 g} 2) literal.token=characters .\pdfliteral origin <lua data reference 153> In the first case the Lua accessor returns a value which happens to be on top of the stack (the key "data" itself). In the second case an index into TeX memory is misinterpreted as a Lua registry index, so the returned data is essentially garbage. Patch for both issues is attached. I also extended `tokenlist_from_lua` (which is what `nodelib_gettoks` is defined as) to allow an index argument. The previous version used the value on top of the stack, which probably worked for every use currently in LuaTeX, but seemed rather dangerous and subtle. The patch is from git, though it can be applied normally with patch -Np1 < pdf_literal.patch Kind regards, Michal Vlasák

2 3

should there be a decode array in the SMask dictionary?
by Ulrike Fischer 30 Dec '22

30 Dec '22

If I run the following with pdftex I get a rather black square (checked in three pdf viewers). With luatex I get a rather light gray square, which looks imho wrong as color values between 0 and 0.2 should be dark. The png can be found here: https://i.stack.imgur.com/8JrYD.png \ifcsname directlua\endcsname \pdfvariable compresslevel 0 \pdfvariable objcompresslevel 0 \saveimageresource attr{/Decode [0 0.2 0 0.2 0 0.2]}{blue_square.png} \useimageresource\the\lastsavedimageresourceindex \else \pdfcompresslevel 0 \pdfobjcompresslevel 0 \pdfximage attr{/Decode [0 0.2 0 0.2 0 0.2]}{blue_square.png} \leavevmode\pdfrefximage \the\pdflastximage \fi \bye pdftex adds a transparency group which is missing in luatex, but it didn't change when I added that manually. The other difference between both engines is that pdftex adds the /Decode array only to the image object dictionary and not also to the Smask dictionary: With pdftex I get as image object dictionary << /Decode [0 0.2 0 0.2 0 0.2] /Type /XObject /Subtype /Image /Width 115 /Height 115 /BitsPerComponent 8 /ColorSpace /DeviceRGB /SMask 8 0 R /Length 39675 >> and as SMask dictionary << /Type /XObject /Subtype /Image /Width 115 /Height 115 /BitsPerComponent 8 /ColorSpace /DeviceGray /Length 13225 >> The image dictionary with luatex is identical but the SMask has also a /Decode array: << /Type /XObject /Subtype /Image /Decode [0 0.2 0 0.2 0 0.2] /Width 115 /Height 115 /BitsPerComponent 8 /ColorSpace /DeviceGray /Length 13225 >> If I disable the Decode array by replacing /Decode with /Dexode then the expected dark square appears. -- Ulrike Fischer http://www.troubleshooting-tex.de/

2 1

luaotfload strange message
by Fabrice Popineau 17 Dec '22

17 Dec '22

Hi everybody, I have this message showing up for some time now: luaotfload | db : Reload initiated (formats: otf,ttf,ttc); reason: Font "CambriaB.ttf" not found. every time I compile the same file. This message is quite recent (TeXLive 2022 ?). It is also strange that I need to state explicitly : \setmainfont{Cambria.otf}[ BoldFont=CambriaB.ttf, ItalicFont=CambriaI.ttf, BoldItalicFont=CambriaI.ttf, BoldItalicFeatures={RawFeature={embolden=5}} ] at the same time (see post https://tex.stackexchange.com/questions/657372/lualatex-cannot-use-bold-cam… ) Any idea what's going wrong with Cambria ? I am using TeXLive/Windows if that matters. Thanks for your help. -- Fabrice

2 1

Wrong tail in node.ligaturing
by Marcel Fabian Krüger 03 Dec '22

03 Dec '22

Hi, in LuaTeX node.ligaturing should return the head and the tail of the list after ligatures got applied. But in the case that the tail of the new list is a discretionary the current code returns the passed in tail instead, assuming that it didn't change. This breaks if the discretionary node wasn't the tail before the ligature pass:. Take for example \directlua{ local b = token.scan_list() local h = b.head local t = node.tail(h) local post_h, post_t = node.ligaturing(h, node.tail(t)) print(node.tail(post_h), post_t) }\hpack{a\discretionary{}{f}{f}f} \bye Here the `f`s in the discretionary form ligatures with the `f` after the discretionary, so after node.ligaturing the list if effectively `a\discretionary{}{ff}{ff}` and therefore `post_t` should point to the discretionary node. But as the output shows, post_t instead is a glyph node while node.tail(post_h) is the expected disc node. This is caused by `handle_lig_word` in luafont.c. `handle_lig_word` is used in `handle_ligaturing` as while (cur != null) { if (type(cur) == glyph_node || (type(cur) == boundary_node)) { cur = handle_lig_word(cur); } prev = cur; cur = vlink(cur); } so it is expected that handle_lig_word returns the last node already handled so that afterwards the loop can continue at vlink(cur). But if the handled segment ends with a discretionary `handle_lig_word` returns the node `after` the last already handled node instead. This is fine if the last node is a non glyph/non boundary node, but if the discretionary ends the segment passed to handle_ligaturing than this means that `handle_lig_word` returns null, therefore settings `prev` to `null` instead of tracking the tail. Also this relies on `vlink(null)` being null, causing issues if this ever gets corrupted (see my next mail for an example...). It can be fixed by making sure that handle_lig_word always returns the last handled node, e.g. using diff --git a/source/texk/web2c/luatexdir/font/luafont.c b/source/texk/web2c/luatexdir/font/luafont.c index 2e08facb1..c33037244 100644 --- a/source/texk/web2c/luatexdir/font/luafont.c +++ b/source/texk/web2c/luatexdir/font/luafont.c @@ -2242,6 +2242,7 @@ static halfword handle_lig_nest(halfword root, halfword cur) static halfword handle_lig_word(halfword cur) { halfword right = null; + halfword last = null; if (type(cur) == boundary_node) { halfword prev = alink(cur); halfword fwd = vlink(cur); @@ -2481,9 +2482,10 @@ static halfword handle_lig_word(halfword cur) } else { /*tex We have glyph nor disc. */ - return cur; + return last; } /*tex Goto the next node, where |\par| allows |vlink(cur)| to be NULL. */ + last = cur; cur = vlink(cur); } return cur; -- Best regards, Marcel

2 2

Dropped kerning around automatic hyphens
by Marcel Fabian Krüger 03 Dec '22

03 Dec '22

Hi, currently LuaTeX does not insert kerning between hyphens and characters before discretionary hyphens if the hyphen was inserted automatically. Take for example (here `a` is used as hyphenation character to simulate a font where kerning with the hyphen is mmre common than in cmr): \showboxdepth=\maxdimen \showboxbreadth=\maxdimen \tracingonline=1 \lefthyphenmin1 \righthyphenmin1 \hyphenation{V-b} \prehyphenchar=`a \setbox0=\vbox{Vb} \showbox0 \bye This results in [...] ..\tenrm V ..\discretionary (penalty 50) ...< \tenrm a ..\tenrm b [...] with no kern between the `V` and the `a`. If the hyphenation point is inserted manually by using \setbox0=\vbox{V\-b} instead the problem disappears and we get the expected [...] ..\tenrm V ..\discretionary (penalty 50) ...< \kern-0.83334 (font) ...< \tenrm a ..\tenrm b [...] Additionally the broken version writes the dropped kern node to vlink(null) breaking any code which relies on vlink(null) being null (see e.g. my previous mail). The issue is that `add_kern_before` in luafont.c relies on alink of the right glyph being valid. Since the right glyph here is the "hyphen" glyph in a discretionary this depends on what `alink` for the beginning of a discretionary list is. Currently this is inconsistent. When set through `set_disc_field` then the `alink` is explicitly set to null to avoid exposing the temporary "nodes" in discretionaries to Lua code. his triggers the bug since the kern gets added after null instead of before the right glyph. If the discretionary gets inserted through a discretionary_cmd by append_discretionary in maincontrol.c then the alink gets explicitly set to these pseudo nodes instead avoiding the issue. It doesn't make much sense to handle this inconsistently this is likely and internal nodes are already exposed in other places, so IMO the best solution is to alink to these nodes in set_disc_field too, e.g. with diff --git a/source/texk/web2c/luatexdir/lang/texlang.c b/source/texk/web2c/luatexdir/lang/texlang.c index a0d067251..3cbbdd3b4 100644 --- a/source/texk/web2c/luatexdir/lang/texlang.c +++ b/source/texk/web2c/luatexdir/lang/texlang.c @@ -470,12 +470,7 @@ static halfword compound_word_break(halfword t, int clang) void set_disc_field(halfword f, halfword t) { if (t != null) { - /*tex - No |couple_nodes(f, t);| as we can better not expose |f| as |prev| - pointer. - */ - vlink(f) = t ; - alink(t) = null ; + couple_nodes(f, t); tlink(f) = tail_of_list(t); } else { vlink(f) = null; -- Best, Marcel

2 1

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

dev-luatex December 2022