- dev-luatex - NTG Mailing Lists

should there be a decode array in the SMask dictionary?
by Ulrike Fischer 30 Dec '22

30 Dec '22

If I run the following with pdftex I get a rather black square (checked in three pdf viewers). With luatex I get a rather light gray square, which looks imho wrong as color values between 0 and 0.2 should be dark. The png can be found here: https://i.stack.imgur.com/8JrYD.png \ifcsname directlua\endcsname \pdfvariable compresslevel 0 \pdfvariable objcompresslevel 0 \saveimageresource attr{/Decode [0 0.2 0 0.2 0 0.2]}{blue_square.png} \useimageresource\the\lastsavedimageresourceindex \else \pdfcompresslevel 0 \pdfobjcompresslevel 0 \pdfximage attr{/Decode [0 0.2 0 0.2 0 0.2]}{blue_square.png} \leavevmode\pdfrefximage \the\pdflastximage \fi \bye pdftex adds a transparency group which is missing in luatex, but it didn't change when I added that manually. The other difference between both engines is that pdftex adds the /Decode array only to the image object dictionary and not also to the Smask dictionary: With pdftex I get as image object dictionary << /Decode [0 0.2 0 0.2 0 0.2] /Type /XObject /Subtype /Image /Width 115 /Height 115 /BitsPerComponent 8 /ColorSpace /DeviceRGB /SMask 8 0 R /Length 39675 >> and as SMask dictionary << /Type /XObject /Subtype /Image /Width 115 /Height 115 /BitsPerComponent 8 /ColorSpace /DeviceGray /Length 13225 >> The image dictionary with luatex is identical but the SMask has also a /Decode array: << /Type /XObject /Subtype /Image /Decode [0 0.2 0 0.2 0 0.2] /Width 115 /Height 115 /BitsPerComponent 8 /ColorSpace /DeviceGray /Length 13225 >> If I disable the Decode array by replacing /Decode with /Dexode then the expected dark square appears. -- Ulrike Fischer http://www.troubleshooting-tex.de/

2 1

luaotfload strange message
by Fabrice Popineau 17 Dec '22

17 Dec '22

Hi everybody, I have this message showing up for some time now: luaotfload | db : Reload initiated (formats: otf,ttf,ttc); reason: Font "CambriaB.ttf" not found. every time I compile the same file. This message is quite recent (TeXLive 2022 ?). It is also strange that I need to state explicitly : \setmainfont{Cambria.otf}[ BoldFont=CambriaB.ttf, ItalicFont=CambriaI.ttf, BoldItalicFont=CambriaI.ttf, BoldItalicFeatures={RawFeature={embolden=5}} ] at the same time (see post https://tex.stackexchange.com/questions/657372/lualatex-cannot-use-bold-cam… ) Any idea what's going wrong with Cambria ? I am using TeXLive/Windows if that matters. Thanks for your help. -- Fabrice

2 1

Wrong tail in node.ligaturing
by Marcel Fabian Krüger 03 Dec '22

03 Dec '22

Hi, in LuaTeX node.ligaturing should return the head and the tail of the list after ligatures got applied. But in the case that the tail of the new list is a discretionary the current code returns the passed in tail instead, assuming that it didn't change. This breaks if the discretionary node wasn't the tail before the ligature pass:. Take for example \directlua{ local b = token.scan_list() local h = b.head local t = node.tail(h) local post_h, post_t = node.ligaturing(h, node.tail(t)) print(node.tail(post_h), post_t) }\hpack{a\discretionary{}{f}{f}f} \bye Here the `f`s in the discretionary form ligatures with the `f` after the discretionary, so after node.ligaturing the list if effectively `a\discretionary{}{ff}{ff}` and therefore `post_t` should point to the discretionary node. But as the output shows, post_t instead is a glyph node while node.tail(post_h) is the expected disc node. This is caused by `handle_lig_word` in luafont.c. `handle_lig_word` is used in `handle_ligaturing` as while (cur != null) { if (type(cur) == glyph_node || (type(cur) == boundary_node)) { cur = handle_lig_word(cur); } prev = cur; cur = vlink(cur); } so it is expected that handle_lig_word returns the last node already handled so that afterwards the loop can continue at vlink(cur). But if the handled segment ends with a discretionary `handle_lig_word` returns the node `after` the last already handled node instead. This is fine if the last node is a non glyph/non boundary node, but if the discretionary ends the segment passed to handle_ligaturing than this means that `handle_lig_word` returns null, therefore settings `prev` to `null` instead of tracking the tail. Also this relies on `vlink(null)` being null, causing issues if this ever gets corrupted (see my next mail for an example...). It can be fixed by making sure that handle_lig_word always returns the last handled node, e.g. using diff --git a/source/texk/web2c/luatexdir/font/luafont.c b/source/texk/web2c/luatexdir/font/luafont.c index 2e08facb1..c33037244 100644 --- a/source/texk/web2c/luatexdir/font/luafont.c +++ b/source/texk/web2c/luatexdir/font/luafont.c @@ -2242,6 +2242,7 @@ static halfword handle_lig_nest(halfword root, halfword cur) static halfword handle_lig_word(halfword cur) { halfword right = null; + halfword last = null; if (type(cur) == boundary_node) { halfword prev = alink(cur); halfword fwd = vlink(cur); @@ -2481,9 +2482,10 @@ static halfword handle_lig_word(halfword cur) } else { /*tex We have glyph nor disc. */ - return cur; + return last; } /*tex Goto the next node, where |\par| allows |vlink(cur)| to be NULL. */ + last = cur; cur = vlink(cur); } return cur; -- Best regards, Marcel

2 2

Dropped kerning around automatic hyphens
by Marcel Fabian Krüger 03 Dec '22

03 Dec '22

Hi, currently LuaTeX does not insert kerning between hyphens and characters before discretionary hyphens if the hyphen was inserted automatically. Take for example (here `a` is used as hyphenation character to simulate a font where kerning with the hyphen is mmre common than in cmr): \showboxdepth=\maxdimen \showboxbreadth=\maxdimen \tracingonline=1 \lefthyphenmin1 \righthyphenmin1 \hyphenation{V-b} \prehyphenchar=`a \setbox0=\vbox{Vb} \showbox0 \bye This results in [...] ..\tenrm V ..\discretionary (penalty 50) ...< \tenrm a ..\tenrm b [...] with no kern between the `V` and the `a`. If the hyphenation point is inserted manually by using \setbox0=\vbox{V\-b} instead the problem disappears and we get the expected [...] ..\tenrm V ..\discretionary (penalty 50) ...< \kern-0.83334 (font) ...< \tenrm a ..\tenrm b [...] Additionally the broken version writes the dropped kern node to vlink(null) breaking any code which relies on vlink(null) being null (see e.g. my previous mail). The issue is that `add_kern_before` in luafont.c relies on alink of the right glyph being valid. Since the right glyph here is the "hyphen" glyph in a discretionary this depends on what `alink` for the beginning of a discretionary list is. Currently this is inconsistent. When set through `set_disc_field` then the `alink` is explicitly set to null to avoid exposing the temporary "nodes" in discretionaries to Lua code. his triggers the bug since the kern gets added after null instead of before the right glyph. If the discretionary gets inserted through a discretionary_cmd by append_discretionary in maincontrol.c then the alink gets explicitly set to these pseudo nodes instead avoiding the issue. It doesn't make much sense to handle this inconsistently this is likely and internal nodes are already exposed in other places, so IMO the best solution is to alink to these nodes in set_disc_field too, e.g. with diff --git a/source/texk/web2c/luatexdir/lang/texlang.c b/source/texk/web2c/luatexdir/lang/texlang.c index a0d067251..3cbbdd3b4 100644 --- a/source/texk/web2c/luatexdir/lang/texlang.c +++ b/source/texk/web2c/luatexdir/lang/texlang.c @@ -470,12 +470,7 @@ static halfword compound_word_break(halfword t, int clang) void set_disc_field(halfword f, halfword t) { if (t != null) { - /*tex - No |couple_nodes(f, t);| as we can better not expose |f| as |prev| - pointer. - */ - vlink(f) = t ; - alink(t) = null ; + couple_nodes(f, t); tlink(f) = tail_of_list(t); } else { vlink(f) = null; -- Best, Marcel

2 1

Re: [Dev-luatex] \Udelcodenum doesn't work properly
by Hans Hagen 18 Nov '22

18 Nov '22

On 11/18/2022 12:25 PM, Petr Olsak wrote: > Sorry, > > I need to set delcodes to Unicode fonts and read them. LuaTeX manual > says that > > ----- > > The following new primitives are compatible with XƎTEX: > > ... > > \Udelcode > > \Udelcodenum > > ----- > > and XeTeX manual says that \Udelcode <charnum>=<family><slot> can save > delcode. and \Udelcodenum can read or save packed <family>/<slot> data > (the packed format isn't specified, but it doesn't matter). I am using > \Udelcode for setting delcode data. I don't know nothing else how to do > this. Now, I need to read saved delcode data using \Udelcodenum for > debugging purposes. Is there another way for saving and reading it? I am > talking only about Unicode fonts, i.e. there is only single pair > <family><slot>, no two pairs like in the classical \delcode. \def\theUdelcodesmallfam {\directlua{tex.print(tex.getdelcode(token.scan_int())[1])}} \def\theUdelcodelargefam {\directlua{tex.print(tex.getdelcode(token.scan_int())[3])}} \def\theUdelcodesmallchar {\directlua{tex.print(tex.getdelcode(token.scan_int())[2])}} \def\theUdelcodelargechar {\directlua{tex.print(tex.getdelcode(token.scan_int())[4])}} \theUdelcodesmallfam \la\ \theUdelcodelargefam \la\ \theUdelcodesmallchar\la\ \theUdelcodelargechar\la\ (as you can also set them there's actually always two pairs) Hans ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl -----------------------------------------------------------------

1 0

\Udelcodenum doesn't work properly
by Petr Olsak 18 Nov '22

18 Nov '22

Hello The XeTeX manual says that \Udelcodenum sets or return packet information about family/slot of the \Udelcode data. It seems that it doesn't work in LuaTeX: \chardef\lx="027E8 \Udelcode\lx=1 "027E8 \the\Udelcodenum\lx % prints 42893312, i.e. "28E8000 \Udelcodenum\lx=\Udelcodenum\lx \the\Udelcodenum\lx % prints -381681664 \bye The slot code "027E8 is mixed with 01 family and \Udelocodenum returns "28E8000. Of course, if I set new Udelcode data using \Udelcodenum\lx=\Udelcodenum\lx then I get totally bad result. On the other hand, XeTeX runing on the same testing file prints in both cases 1075849192, i.e "402027E8. The slot code "027E8 isn't mixed with the family number. Petr Olsak

2 1

\intop without \nolimits gives bas spacing
by Petr Olsak 17 Nov '22

17 Nov '22

Hello suppose following testing file: ------------------- CM, intop+nolimits: $\intop\nolimits_0^1$ CM, intop directly: $\intop_0^1$ \ifx\directlua\undefined \else \input luafonts \fi \font\fA=[latinmodern-math]:mode=base;script=math;ssty=0; \font\fB=[latinmodern-math]:mode=base;script=math;ssty=1; at7pt \Umathchardef\intop="1"00"00222B \textfont0=\fA \scriptfont0=\fB LM, intop+nolimits $\intop\nolimits_0^1$ LM, intop directly $\intop_0^1$ \bye ------------------- The first two output lines print integral via classical PlainTeX setting with Coputer Modern fonts. We can see that there is no difference between \intop without \nolimits and with \nolimits. The following two output lines shows LatinModern-math Unicode font. First prints \intop with \nolimits, the result is with somewhat tightly spacing but it is not our problem. This is due to suboptimal font parameters. But the last line prints \intop without \nolimits and there is significantly difference: big space after \intop before limits. IMHO, it is a bug in LuaTeX. If we run the same testing file via XeTeX then there is no difference between third and last line of output. Petr Olsak

2 2

letter spacing in display math
by blumens＠fi.muni.cz 24 Sep '22

24 Sep '22

Hello, using fonts with additional letter spacing does not seem to work in display formulae. (Not sure whether it's a bug in luatex or whether I should report it to luaotfload instead.) Example (LuaHBTeX, Version 1.15.0): \documentclass{minimal} \begin{document} \font\f="DejaVuSerif-Italic:letterspace=20.0" at 10pt \f % these work as expected \hfill abcdefxyz\hfill\hbox{} \hfill$\textfont1=\f abcdefxyz$\hfill\hbox{} \hfill$\textfont1=\f\displaystyle abcdefxyz$\hfill\hbox{} % these don't $$\textfont1=\f abcdefxyz$$ $$\textfont1=\f\textstyle abcdefxyz$$ \end{document} Am I missing something? Achim

2 2

\Uchar errors with "FFFD
by Ulrike Fischer 16 Aug '22

16 Aug '22

\Uchar"FFFD \bye errors with ! String contains an invalid utf-8 sequence. l.93 \Uchar"FFFD (^^^^fffd works) -- Ulrike Fischer http://www.troubleshooting-tex.de/

3 6

Fwd: Importing .tex files using \directlua to navigate files and folders
by Hans Hagen 12 Aug '22

12 Aug '22

-------- Forwarded Message -------- Subject: Re: [Dev-luatex] Importing .tex files using \directlua to navigate files and folders Date: Fri, 12 Aug 2022 09:44:24 +0200 From: Hans Hagen <j.hagen(a)xs4all.nl> To: Taco Hoekwater <taco(a)bittext.nl> On 8/12/2022 9:30 AM, Taco Hoekwater wrote: > > >> On 11 Aug 2022, at 14:08, paolo de luca <teugon(a)gmail.com> wrote: >> >> Hi all, >> >> I've been trying to import all tex files and inside a given folder, the issue I'm facing is that my lua call is not able to navigate folders: it only works for files. >> It's worth mentioning that compilation successfully completes as the document is created, but I have no errors explaining me why it's not working as intended. >> I've also opened a question on tex.stackexchange. >> >> would you mind having a look at it ? >> >> https://tex.stackexchange.com/questions/653499/understanding-implicit-error… > > > See comment on SX. Don't 'return' the nested call, and it works just fine. > > function inputAll(dir) > for content in lfs.dir(dir) do > if ("." ~= content) and (".." ~= content) then > fullpath = dir .."/".. content > contentType = lfs.attributes(fullpath, "mode") > if isTexFile(content, contentType) then > tex.sprint(" > \\ > input{" .. fullpath .. "}") > elseif ("directory" == contentType) then > -- return > inputAll(fullpath) > end > end > end > end yes, the return is quitter, but even then one can run into some nested directory handle issue especially when one does things inside that loop on one of the directories (maybe the \input results in new files there or files get deleted and or ..) and one wants to have a predictable sorted list i assume so i tend to collect first Hans ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl -----------------------------------------------------------------

1 0