March 2021 - dev-luatex - NTG Mailing Lists

Luatex 1.12.0 announcement.
by luigi scarso 27 May '23

27 May '23

============================================================== LuaTeX 1.12.0 2020-03-15 ============================================================== This is the release for TeX live 2020. --shell-restricted now forbids loading of dso (dll/so object) Scaled virtual font Aadditional primitives \eTeXglue[stretch|shrink]order for querying order the etex way. Extra features runtoks tex.getmodenames() (as these can differ per engine/version) Permit nested runtoks in more complex situations of nesting (HH) More accurate and correct test for tex.[set|get]math Minor clean-up and bugs fixed -- luigi

4 8

\tracingtokens=1, ( ) are logged curiously
by Petr Olsak 21 May '21

21 May '21

Suppose: ----------------------------------------- \tracingscantokens=1 \scantextokens{first} \scantextokens{second} \bye ----------------------------------------- and run luatex test. Then the ( and ) are logged curiously: ( ( ... )) Why all closing )) are logged after end command? If we change \scantextokens to \scantokens, then ( and ) behaves more logical in log file and in the terminal: ( ) ( ). Petr Olsak

3 3

What exactly means \suppressmathparerror=1 ?
by Petr Olsak 28 Mar '21

28 Mar '21

The \suppressmathparerror=1 should suppress \par errors in math mode. OK, this works: ----------------- \suppressmathparerror=1 $$ a b $$ \bye ------------------ but the following example gives error: Display math should end with \Ustopdisplaymath ------------------- \suppressmathparerror=1 $$ \halign{#\cr a\cr} $$ \bye ------------------- The LuaTeX manual does not exactly describes the behavior of this case. So, I don't know if this is feature or bug. Note that the second example is primitive meaning of something like this: -------------------- $$ \eqalignno{...} $$ -------------------- If a user know that "empty lines are allowed in math mode" then he/she could leave empty line after \eqalignno too. Best regards Petr Olsak

3 2

segfault in luatex, assert in pdftex
by Martin Budaj 16 Mar '21

16 Mar '21

Hi, there is a segfault produced by LuaTeX, Version 1.12.0 (TeX Live 2020/Debian) when processing the following: \ifdefined\directlua \protected\def\pdfmapfile {\pdfextension mapfile } \protected\def\pdfmapline {\pdfextension mapline } \edef\pdfgentounicode {\pdfvariable gentounicode} \protected\def\pdfglyphtounicode {\pdfextension glyphtounicode } \fi \pdfglyphtounicode{A}{0041} \pdfgentounicode=1 \pdfmapfile{} \pdfmapline{cmr10 CMR10 34} % no font embedding anything \end PdfTex, Version 3.14159265-2.6-1.40.21 (TeX Live 2020/Debian) gives the following assertion: pdftex: ../../../texk/web2c/pdftexdir/writefont.c:555: write_fontdictionary: Assertion `fo->fd->builtin_glyph_names != NULL' failed. Aborted If the combination of using \pdfgentounicode and not embedding any font is invalid, some reasonable error message should be produced. Best regards Martin

2 3

Wrong spacing for OpenType math subscripts
by Johannes Rosenberger 15 Mar '21

15 Mar '21

Hi LuaTeX developers, first of all, thank you very much for all your work on this and the great OpenType support and possibility of fixing internals using Lua code! In the following document, the math subscripts are so close to the following characters that they sometimes overlap: \documentclass{article} \usepackage{unicode-math} \def\supp{{\rm supp}} \begin{document} $$ I(P_X,P_{Y|X}) = \sum_{(X,Y) \in \supp P_{XY}} P_{XY}(X,Y) \log_2 \frac{P_{XY}(X,Y)}{P_X(X) P_Y(Y)}. $$ \end{document} The problem cannot be fixed by simply adding spacing, e.g. \Uordopenspacing, because the space is different per character. We need italics correction, in all circumstances where an italic symbol is last in the subscript and something follows the noad. By the manual, Section 7.6.4 this is not applied to subscripts, but only the base characters. Setting \mathitalicsmode=1 to force it changes nothing, because italics correction is then only applied in the subscript to the characters before the last one. Maybe luatex assumes the last character to be followed by nothing, because in the mlist of the subscript follows nothing even if after the whole noad follows something. Setting \mathitalicsmode=1 and adding manual 0-kerns (like \/) helps. This is implemented by the following lua code: \directlua{ ty = node.types() sub_addkern = function(sub) scan_sub_addkern(sub) local kern = node.new("kern") if ty[sub.id] == "math_char" or ty[sub.id] == "math_char_text" then local old = node.new("noad", 0) old.nucleus = sub sub = node.new("sub_mlist") sub.head = old node.insert_after(sub.head, old, kern) elseif ty[sub.id] == "sub_box" or ty[sub.id] == "sub_mlist" then local tail = node.tail(sub.head) if not (ty[tail.id] == "kern") then node.insert_after(sub.head, tail, kern) end end return sub end scan_sub_addkern = function(n) if n.head then n.head = scan_all_sub_addkern(n.head) end if n.sub then n.sub = sub_addkern(n.sub) end if n.nucleus then scan_sub_addkern(n.nucleus) end if n.num then scan_sub_addkern(n.num) end if n.denom then scan_sub_addkern(n.denom) end end scan_all_sub_addkern = function(head) for n in node.traverse(head) do scan_sub_addkern(n) end return head end luatexbase.add_to_callback("pre_mlist_to_hlist_filter", scan_all_sub_addkern, "default mlist_to_hlist + italics-corrected subscript") } XeTeX does this right out of the box. Best, Johannes

3 4

[fs]io.readinteger4 produces excessively small negative values
by Marcel Fabian Krüger 07 Mar '21

07 Mar '21

Hi, Look at the texlua script: print(sio.readinteger4(string.pack(">i", -1), 1)) It would be expected that this prints "-1", but at least is should print a number in the range of 4-byte signed integers (-2147483648 -- 2147483647). Instead it prints -4294967297. The same issue appears with fio.readinteger4 and [fs]readintegertable(..., 4): Whenever the value is negative, the returned value is 2^32 lower than expected. (Technically this only happens if Lua's integer type allows at least 64-bit integers and the native "int" type has at most 32-bit, but this is the case on basically any current platform. The cause is code like the following in the affected C implementations: int a = ...; int b = ...; int c = ...; int d = ...; if (a >= 0x80) lua_pushinteger(L, 0x1000000 * a + 0x10000 * b + 0x100 * c + d - 0x100000000); else ...; Here a, b, c, d are "int", so according to C language rules "0x1000000 * a + 0x10000 * b + 0x100 * c + d" is evaluated as a (signed) int. If a>=0x80 then 0x1000000*0x80 is bigger than 2^31 and can therefore not be represented in a (32-bit) int. Theoretically this triggers undefined behavior since LuaTeX does not compile with "-fwrapv" or similar, but on my system it does "the expected thing" and wraps. Therefore the value is already negative and the subtraction of 0x100000000, which is evaluated in 64bit since the literal can not be represented in 32bit, leads to the unexpected value. This can be fixed by making sure that the expression is completely evaluated with 64-bit integers (or whatever integer type Lua uses). A possible patch is attached. Best regards, Marcel

3 2

Including PDF images with page /Metadata streams
by Marcel Fabian Krüger 01 Mar '21

01 Mar '21

Hi, (corresponding bug report for LaTeX: https://tex.stackexchange.com/questions/585289/corrupt-pdf-with-includegrap… ) when LuaTeX includes a PDF file in which a Page object contains a Metadata stream, then the output is a invalid PDF file since LuaTeX adds the stream inline into the directory instead of adding a reference. plain LuaTeX example: Download page.pdf from https://bitbucket.org/longwayahead/latex-problem/src/master/ and then compile with plain LuaTeX: \saveimageresource{./page.pdf} \useimageresource\lastsavedimageresourceindex \bye The issue can be fixed by removing a single character: In pdftoepdf.c, line 875 a comment correctly mentions that indirection has to be preserved, but for this to work the previous ppdict_rget_obj has to be replaced with ppdict_get_obj to ensure that indirections are not already resolved. Best regards, Marcel diff --git a/source/texk/web2c/luatexdir/image/pdftoepdf.c b/source/texk/web2c/luatexdir/image/pdftoepdf.c index 78dab3a37..ca68ba8dc 100644 --- a/source/texk/web2c/luatexdir/image/pdftoepdf.c +++ b/source/texk/web2c/luatexdir/image/pdftoepdf.c @@ -864,15 +864,15 @@ void write_epdf(PDF pdf, image_dict * idict, int suppress_optional_info) if (obj != NULL && obj->type != PPREF) { formatted_warning("pdf inclusion","/Metadata must be indirect object"); } /* copy selected items in Page dictionary */ for (i = 0; pagedictkeys[i] != NULL; i++) { - obj = ppdict_rget_obj(pageDict, pagedictkeys[i]); + obj = ppdict_get_obj(pageDict, pagedictkeys[i]); if (obj != NULL) { pdf_add_name(pdf, pagedictkeys[i]); /* preserves indirection */ copyObject(pdf, pdf_doc, obj); }

2 1