- dev-luatex - NTG Mailing Lists

Re: [Dev-luatex] bug#48064: texlive-* packages fail to build non-deterministically
by Ludovic Courtès 31 Dec '21

31 Dec '21

Hello, While investigating luatex crashes in the TeX Live 2020 package of GNU Guix¹, we identified the following heap corruption reported by Valgrind (this is on GNU/Linux, with glibc 2.33): --8<---------------cut here---------------start------------->8--- sh-5.0$ ~ludo/.guix-profile/bin/valgrind --extra-debuginfo-path=/gnu/store/f933bvd6ab6l2lg6xl6k1a6jwvcls0z6-glibc-2.33-debug/lib/debug "luatex" "-interaction=nonstopmode" "-output-directory=build" "&luatex" "amsbsy.dtx" ==28531== Memcheck, a memory error detector ==28531== Copyright (C) 2002-2017, and GNU GPL'd, by Julian Seward et al. ==28531== Using Valgrind-3.16.1 and LibVEX; rerun with -h for copyright info ==28531== Command: luatex -interaction=nonstopmode -output-directory=build &luatex amsbsy.dtx ==28531== This is LuaTeX, Version 1.12.0 (TeX Live 2020) restricted system commands enabled. ==28531== Invalid write of size 8 ==28531== at 0x485C691: lua_pushlstring (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x568E03: load_hyphenation (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x56B41C: undump_language_data (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x4DFB9F: load_fmt_file (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x4EF0ED: main_body (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x45118D: main (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== Address 0xae14170 is 0 bytes after a block of size 1,168 alloc'd ==28531== at 0x483EBE1: realloc (in /gnu/store/jlmh0jbgr6zn4iyvhfbvxps8pykzj5ry-valgrind-3.16.1/lib/valgrind/vgpreload_memcheck-amd64-linux.so) ==28531== by 0x46695D: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x486D932: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x48660F2: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x4868BE7: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x4868FCF: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x486988B: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x485C6BB: lua_pushlstring (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x568E03: load_hyphenation (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x56B41C: undump_language_data (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x4DFB9F: load_fmt_file (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x4EF0ED: main_body (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== ==28531== Invalid write of size 4 ==28531== at 0x485C6A2: lua_pushlstring (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x568E03: load_hyphenation (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x56B41C: undump_language_data (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x4DFB9F: load_fmt_file (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x4EF0ED: main_body (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x45118D: main (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== Address 0xae14178 is 8 bytes after a block of size 1,168 alloc'd ==28531== at 0x483EBE1: realloc (in /gnu/store/jlmh0jbgr6zn4iyvhfbvxps8pykzj5ry-valgrind-3.16.1/lib/valgrind/vgpreload_memcheck-amd64-linux.so) ==28531== by 0x46695D: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x486D932: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x48660F2: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x4868BE7: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x4868FCF: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x486988B: ??? (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x485C6BB: lua_pushlstring (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/lib/libtexlua53.so.5.3.5) ==28531== by 0x568E03: load_hyphenation (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x56B41C: undump_language_data (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x4DFB9F: load_fmt_file (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== by 0x4EF0ED: main_body (in /gnu/store/w20xxg8p0wksbrxxvj3y46fngvr3954w-texlive-bin-20200406/bin/luatex) ==28531== [...] valgrind: m_mallocfree.c:305 (get_bszB_as_is): Assertion 'bszB_lo == bszB_hi' failed. valgrind: Heap block lo/hi size mismatch: lo = 1232, hi = 68. This is probably caused by your program erroneously writing past the end of a heap block and corrupting heap metadata. If you fix any invalid writes reported by Memcheck, this assertion failure will probably go away. Please try that before reporting this as a bug. --8<---------------cut here---------------end--------------->8--- Does that ring a bell? Is there a chance this problem was fixed in the meantime? Thanks in advance, Ludovic. ¹ https://issues.guix.gnu.org/48064

3 4

Erroneous error and help messages
by Hironobu Yamashita 29 Dec '21

29 Dec '21

Hi, The following MWE shows two LuaTeX-specific issues: * It does not print the primitive name "\write" * Tiny typo: double apostrophes in the word "didn''t" ===== \nonstopmode \outer\def\F{hoge} \immediate\write-1{\F}% => looks wrong % ! Forbidden control sequence found while scanning text of \ . \message{\F}% => OK % ! Forbidden control sequence found while scanning text of \message. \par\spacefactor\relax% The log file contains % "I'll just pretend that you didn''t ask for it." \bye ===== Best, Hironobu Yamashita

2 3

os.uname on 64 bit Windows
by Reinhard Kotucha 23 Dec '21

23 Dec '21

Hi, on a 64 bit Windows machine os.uname() erroneously returns machine i686 On the same machine I get under Linux machine x86_64 with both, x86_64-linux and i386-linux binaries. Thus I assume that the keyword 'machine' refers to the hardware, not to how the binaries were compiled (32 vs. 64 bit). The complete output of for k,v in pairs(os.uname()) do print(k,v) end is release build 9200 nodename R804 version 6.02 machine i686 sysname Windows 8 Regards, Reinhard -- ------------------------------------------------------------------ Reinhard Kotucha Phone: +49-511-3373112 Marschnerstr. 25 D-30167 Hannover mailto:reinhard.kotucha@web.de ------------------------------------------------------------------

3 8

luatex svn git sync
by Norbert Preining 21 Dec '21

21 Dec '21

Hi all, I am tending to disable the svn-git mirroring I am doing of luatex from svn to github, since now since considerable time the svn server seems to be broken: > Can't create session: Unable to connect to a repository at URL 'https://serveur-svn.lri.fr/svn/modhel/luatex': Unexpected server error 500 'Proxy Error' on > '/svn/modhel/luatex' at /usr/share/perl5/Git/SVN.pm line 148. Any comments? And btw, is it really still necessary to use this rather unconventional development space ...? All the best Norbert -- PREINING Norbert https://www.preining.info Fujitsu Research + IFMGA Guide + TU Wien + TeX Live GPG: 0x860CDC13 fp: F7D8 A928 26E3 16A1 9FA0 ACF0 6CAC A448 860C DC13

6 11

Wrong placement using \displaylimits and unicode-math
by Jakub Kaczor 08 Dec '21

08 Dec '21

Hello there, there were some reports regarding the placement of the limits in integrals a few years ago <https://tug.org/pipermail/luatex/2015-March/005076.html>. It was with regard to display math and `\limits`. They seem to work fine for me, but I spotted some weird behavior using `\displaylimits` *in in-line math*. In my opinion, the limits of integration are placed way too much on the right. The expected behavior is to have the same placement as with `\nolimits` in in-line math, and as with `\limits` in display math. The problem doesn't occur with XeLaTeX and it seems to be independent of a font. Here is a minimal working example comparing different options: ``` latex %! TeX program = lualatex \documentclass{article} \usepackage{unicode-math} \begin{document} $\int\limits_a^b f(x)\,\mathrm dx$ $\int\nolimits_a^b f(x)\,\mathrm dx$ $\int\displaylimits_a^b f(x)\,\mathrm dx$ \[\int\limits_a^b f(x)\,\mathrm dx\] \[\int\nolimits_a^b f(x)\,\mathrm dx\] \[\int\displaylimits_a^b f(x)\,\mathrm dx\] \end{document} ```` Here, the third line after `\begin{document}` is the faulty one. Best regards Jakub Kaczor

1 0

luahbtex Mac M1 memory
by Oliver Marugg 08 Dec '21

08 Dec '21

Hi Yesterday I experienced some strange memory issues on mac mini running maco 12.0.1 (monterey) with luabhbtex 1.13.2 (installed via texlive 2021 w. latest updates via tlmgr) and texstudio 4.1.1 as frontend. I read about memory leaks with m1 CPUS. I found out that the process luahbtex run with 33GB virtual memory permanently (without having a job to run) and used 99-100% CPU load, CPU was running hot. Instead of investigating, I killed the process and memory as well CPU load went back to normal. What could I do for you next time I experience such an effect? Many thanks. Ollie Marugg

1 0

Trouble with generating warning messages in Unicode
by निरंजन 30 Nov '21

30 Nov '21

Hello, I am having trouble with generating a warning message with unicode characters and LuaLaTeX. My code is as follows: \documentclass{article} \begin{filecontents}[overwrite]{quack.sty} \ProvidesPackage{quack}[2021/11/30 v0.1 quack quack] \newcommand{\quack}{% \PackageWarningNoLine{quack}{% ककाकिकी खखाखिखी गगागिगी घघाघिघी ङङाङिङी\MessageBreak चचाचिची छछाछिछी जजाजिजी झझाझिझी ञञाञिञी\MessageBreak टटाटिटी ठठाठिठी डडाडिडी ढढाढिढी णणाणिणी% }% } \end{filecontents} \usepackage{quack} \begin{document} \quack \end{document} If I run this with xelatex, the warning message is printed as expected. With pdflatex and lualatex it isn't. In a GitHub issue[1] I was told that pdftex and luatex count in bytes and I need to reset it with max_print_line in order to print this warning correctly. As it has to be set in the .cnf or .ini files in the local installations or per compile, I asked if it can be set in the TeX code. They told me to report this to luatex developers and therefore I am mailing this issue here. There are two questions: 1. If I set the max_print_line to, say 300, it prints the log in an unusual way. Everything in the log is affected. So can luatex be requested to count the strings the way XeLaTeX counts them? What implication will it have? 2. If the above is not possible/worth/advisable; can there be a feature to set the max_print_line in the TeX code? David Carlisle says[2] in LuaTeX it can be checked, but not changed. [1]: https://github.com/lualatex/luatexbase/issues/22 [2]: https://github.com/lualatex/luatexbase/issues/22#issuecomment-982553035

1 0

\partokenname, \partokencontext in LuaTeX?
by Petr Olsak 19 Nov '21

19 Nov '21

Hello, may I ask if the primitives \partokenname, \partokencontext will be implemented into LuaTeX? They were implemented in pdftex and XeTeX into TeXlive sources. I would very much welcome their implementation in LuaTeX, I need then on OpTeX macros. Regards Petr Olsak ----------- texk/web2c/NEWS: - new primitives \partokenname and \partokencontext allow overriding the name of the internally-emitted \par token at blank lines, the end of vboxes, etc. ----------- \pdftexprimitive{\Syntax{\Tex{\partokenname} \Whatever{control-sequence}}} \bookmark{\tex{partokenname}} \TeX{} inserts the {\it par-token} at empty lines and at various more places into the input stream. Its meaning is {\it end-paragraph} by default and it can be changed (by \type{\def}, for example). Its name is \type{\par} by default and you can change its name by \type{\partokenname}\Something{control-sequence}. The name of the {\it par-token} is given \Something{control-sequence}. The setting performed by \type{\partokenname} is global. The no-\type{\long} macros throw the error ``runaway argument'' if {\it par-token} is scanned to its parameter regardless its name. The following example releases the name \type{\par} to the ``user name space'', i.e.\ users can define and use \type{\par} as they need without any influence to behavior of internal \TeX{} algorithms. \starttyping \catcode`\_=11 \let\_par=\par \partokenname\_par Hello world.\end \stoptyping The token with name \type{\_par} is auto-emitted at the empty line and before \type{\end} primitive in this example. The no-\type{\long} macros can read parameters with \type{\par} but \type{\_par} is prohibited. \pdftexprimitive{\Syntax{\Tex{\partokencontext} \Whatever{number}}} \bookmark{\tex{partokencontext}} The {\it par-token} (i.e.\ the token with the name \type{\par} or with the name given by \type{\partokenname}) is inserted into the input stream depending on the \type{\partokencontext} value. Its value can be: 0: {\it par-token} is inserted at empty lines (more exactly, when a token category 5 is found in the state~$N$ of reading a line) and before \type{\end}, \type{\vskip}, \type{\hrule}, \type{\unvbox}, and \type{\halign} when \TeX{} is in horizontal mode and at various error recovery cases. 1: {\it par-token} is inserted as above and moreover at the end of \type{\vbox}, \type{\vtop}, and \type{\vcenter} if \TeX{} is in horizontal mode. 2: {\it par-token} is inserted as above and moreover at the end of \type{\insert}, \type{\vadjust}, \type{\output}, \type{\noalign}, and items of \type{\valign} if \TeX{} is in horizontal mode. Default is \type{\partokencontext=0}, i.e.\ the cases 1 and 2 are processed by direct call of {\it end-paragraph} routine without emitted {\it par-token}. This is classical \TeX{} behavior. If \type{\partokencontext=1} then \TeX\ inserts {\it par-token} in additional cases: when vertical boxes are completed but horizotal mode is not finished. The settings \type{\partokencontext=2} deactivates all cases where classical \TeX\ uses direct {\it end-paragraph} routine and {\it par-token} is inserted in such cases. The setting value to the register \type{\partokencontext} is local.

2 1

math.tointeger in l-math
by Robert 18 Nov '21

18 Nov '21

Hi, [sorry, I know it's the wrong list, but I'm not subscribed to ntg-context] I think line 144 in l-math.lua should read function math.ult(m,n) otherwise, the function math.tointeger would be overwritten with older luatex versions. (reference: https://source.contextgarden.net/tex/context/base/mkiv/l-math.lua ) Best, -- Robert

1 0

Synctex bug
by Michael Klooss 21 Oct '21

21 Oct '21

Hello, I hope this is the right place to report lualatex bugs. The lualatex ecosystem seems to have a synctex bug which has been resolved in pdflatex and xelatex some time ago. The problem is, that inverse search sometimes goes to the wrong file. The trigger seems to be the TikZ library shadows. An example and further references (detailing the bug) are below. Best, Michael % From https://sourceforge.net/p/pgf/bugs/333/ % See also https://tug.org/pipermail/tex-live/2017-March/039781.html % See also https://tex.stackexchange.com/questions/300079/goto-source-opens-pgflibrary… % The stackexchange ^ contains a workaround. I haven't tried it yet. % The problem only occurs with lualatex. pdflatex and xelatex work fine. \documentclass{article} \usepackage{tikz} \usetikzlibrary{shadows} \begin{document} Test. \end{document}

2 1