May 2010 - dev-luatex - NTG Mailing Lists

callbacks newbie question: extracting the hyphenation
by Mojca Miklavec 19 May '10

19 May '10

Dear lua experts, For our repository of hyphenation patterns I would like to create a document that: - reads in a file with hyphenation patterns - reads in plain text file (say one word per line) - creates output such as "hy{\nicehyphen}phen{\nicehyphen}ation" for each word I'm testing eshyph-test.tex by Javier Bezos from http://www.ctan.org/tex-archive/language/spanish/hyphen/base/ (trying to run it with ConTeXt :), but I don't understand how exactly the callbacks work. For example, I cannot get the following code to work in ConTeXt (but it works with luatex in TL 09): \starttext \directlua{ callback.register('pre_linebreak_filter', function(h, groupcode) return true end) } abc \stoptext ! LuaTeX error ...text/tex/texmf-context/tex/context/base/luat-cbk.lua:39: attempt to call global 'format' (a nil value) stack traceback: ...text/tex/texmf-context/tex/context/base/luat-cbk.lua:39: in function <...text/tex/texmf-context/tex/context/base/luat-cbk.lua:38> (tail call): ? <\directlua >:1: in main chunk. l.8 } ? Here's the code that runs in luatex (it's all just a simplified Javier's code) and prints hyphenated words to terminal. Is there some more elegant way to do it? Is there a way to print it back to the document (I understand the problem why the currect approach would fail to work directly)? And why does it fail in ConTeXt? Thanks a lot for any hints, Mojca % one needs to create an arbitrary file words.txt, even if it just contains two words \directlua{\unexpanded{ local glyph = node.id('glyph') local disc = node.id('disc') local glue = node.id('glue') callback.register('pre_linebreak_filter', function(h, groupcode) word = '' for t in node.traverse(h) do if node.id(t.id) == glyph and t.subtype == 0 then word = word .. unicode.utf8.char(t.char) elseif node.id(t.id) == disc then word = word .. '-' elseif node.id(t.id) == glue then word = word .. ' ' end end % texio.write_nl('NODE type=' .. node.type(t.id) .. ' subtype=' .. t.subtype ) % if t.id == glyph then % texio.write(' font=' .. t.font .. ' char=' .. unicode.utf8.char(t.char)) % end texio.write_nl(' -- ' .. word) return true end) }} % \pdfnoligatures \hbadness=10000 \hfuzz=\maxdimen \def\p#1{#1\setbox0\vbox{\hsize0pt #1}} \directlua{\unexpanded{ local words = io.open('words.txt') for w in words:lines() do tex.print('\\p{' .. w .. '}') end words:close() }} \bye

2 1

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 17 May '10

17 May '10

------------------------------------------------------------------------ r3693 | hhenkel | 2010-05-16 22:27:33 +0200 (Sun, 16 May 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/pdf/pdfgen.w speed up pdf_print_real() ------------------------------------------------------------------------ r3694 | hhenkel | 2010-05-16 22:35:43 +0200 (Sun, 16 May 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/pdf/pdfgen.w revert to safer version ------------------------------------------------------------------------ r3695 | hhenkel | 2010-05-16 22:52:03 +0200 (Sun, 16 May 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/lua/lpdflib.c more uses for pdf_out_block() ------------------------------------------------------------------------ r3696 | hhenkel | 2010-05-16 23:14:34 +0200 (Sun, 16 May 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/pdf/pdfobj.w yet more pdf_out_block() ------------------------------------------------------------------------

1 0

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 16 May '10

16 May '10

------------------------------------------------------------------------ r3690 | hhenkel | 2010-05-16 19:28:14 +0200 (Sun, 16 May 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/image/epdf.h M /trunk/source/texk/web2c/luatexdir/lua/lepdflib.cc M /trunk/source/texk/web2c/luatexdir/pdf/pdfgen.h M /trunk/source/texk/web2c/luatexdir/pdf/pdfgen.w make more use of pdf_out_block_function() (more to follow) ------------------------------------------------------------------------ r3691 | hhenkel | 2010-05-16 19:37:57 +0200 (Sun, 16 May 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/pdf/pdfgen.w M /trunk/source/texk/web2c/luatexdir/pdf/pdfliteral.w typo (sorry) + pdfliteral ------------------------------------------------------------------------ r3692 | hhenkel | 2010-05-16 21:20:33 +0200 (Sun, 16 May 2010) | 3 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/image/epdf.h M /trunk/source/texk/web2c/luatexdir/lua/luanode.w M /trunk/source/texk/web2c/luatexdir/pdf/pdfgen.h M /trunk/source/texk/web2c/luatexdir/pdf/pdfgen.w M /trunk/source/texk/web2c/luatexdir/pdf/pdfliteral.w rename pdf_out_block() --> pdf_out_block_macro(), pdf_out_block_function() --> pdf_out_block() ------------------------------------------------------------------------

1 0

Perplexing behaviour with \directlua and tex.print
by Graham Douglas 16 May '10

16 May '10

Dear All I am getting some strange behaviour with the following minimal example via LaTeX with LuaTeX \pdfoutput=1 \documentclass[12pt]{article} \begin{document} \directlua{tex.print("{\it abc}")} \end{document} I run the above and get a PDF which displays the following text protect protect protect edef OT1OT1let enc@update I have no idea what is causing this. If I run the following using plain TeX: \pdfoutput=1 \directlua{tex.print("{\it abc}")} \bye I get a PDF which says: am itfam enit abc What am I doing wrong to cause this behaviour? Log file contains (\end occurred inside a group at level 1) ### simple group (level 1) entered at line 1 ({) ### bottom level Cheers Graham Here's the log file from the pdflatex run: ============== This is LuaTeX, Version beta-0.53.0-2010032719 (format=pdflatex 2010.4.13) 16 MAY 2010 18:53 **g:/msys/1.0/trunk/build/texk/latex2.tex (g:/msys/1.0/trunk/build/texk/latex2.tex LaTeX2e <2009/09/24> (g:/msys/1.0/trunk/build/texk/formats/pdflatex/base/article.cls Document Class: article 2007/10/19 v1.4h Standard LaTeX document class (g:/msys/1.0/trunk/build/texk/formats/pdflatex/base/size12.clo File: size12.clo 2007/10/19 v1.4h Standard LaTeX file (size option) ) \c@part=\count79 \c@section=\count80 \c@subsection=\count81 \c@subsubsection=\count82 \c@paragraph=\count83 \c@subparagraph=\count84 \c@figure=\count85 \c@table=\count86 \abovecaptionskip=\skip41 \belowcaptionskip=\skip42 \bibindent=\dimen102 ) (./latex2.aux) LaTeX Font Info: Checking defaults for OML/cmm/m/it on input line 2. LaTeX Font Info: ... okay on input line 2. LaTeX Font Info: Checking defaults for T1/cmr/m/n on input line 2. LaTeX Font Info: ... okay on input line 2. LaTeX Font Info: Checking defaults for OT1/cmr/m/n on input line 2. LaTeX Font Info: ... okay on input line 2. LaTeX Font Info: Checking defaults for OMS/cmsy/m/n on input line 2. LaTeX Font Info: ... okay on input line 2. LaTeX Font Info: Checking defaults for OMX/cmex/m/n on input line 2. LaTeX Font Info: ... okay on input line 2. LaTeX Font Info: Checking defaults for U/cmr/m/n on input line 2. LaTeX Font Info: ... okay on input line 2. [1 {g:/msys/1.0/trunk/build/texk/fonts/map/pdftex.map}] (./latex2.aux) ) (\end occurred inside a group at level 1) ### simple group (level 1) entered at line 1 ({) ### bottom level Here is how much of LuaTeX's memory you used: 210 strings out of 95220 100000,74296 words of node,token memory allocated 264 words of node memory still in use: 2 hlist, 1 vlist, 1 rule, 2 glue, 40 glue_spec, 1 write nodes avail lists: 2:12,3:3,4:29,5:1,6:60,7:1,9:6,10:4 3678 multiletter control sequences out of 65536+0 15 fonts using 431807 bytes 22i,4n,19p,181b,116s stack positions out of 300i,50n,60p,3000b,4000s <g:/msys/1.0/trunk/build/texk/fonts/type1/cm/cmr12.PFB> Output written on latex2.pdf (1 page, 6022 bytes). PDF statistics: 10 PDF objects out of 1000 (max. 8388607) 0 named destinations out of 1000 (max. 131072) 1 words of extra memory for PDF output out of 10000 (max. 10000000)

2 1

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 16 May '10

16 May '10

------------------------------------------------------------------------ r3689 | hhenkel | 2010-05-16 13:34:25 +0200 (Sun, 16 May 2010) | 12 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/image/epdf.h M /trunk/source/texk/web2c/luatexdir/image/pdftoepdf.cc M /trunk/source/texk/web2c/luatexdir/lua/lepdflib.cc A check was missing, if a PDFDoc object from epdf.open() had not been deleted meanwhile, so that all derived Lua variables (which are pointers into the XPDF structure) would point to illegal addresses, causing a segfault. The cleanest fix may be to use the luaL_ref() and luaL_unref() mechanism with __gc, but that gets ugly, if the number of arguments for a Lua accessor function differs; it would need to keep all references with the variable. Instead (as a try, it may change) now a counter is used, which increments always if anything happened to the PDFDoc (closing, re-opening). By this counter it is assured that the PDFDoc object is the same as long as any derived variable is used; else a Lua error is generated. It't a bit tedious, bloating the code, but it seems to be fast. ------------------------------------------------------------------------

1 0

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 16 May '10

16 May '10

------------------------------------------------------------------------ r3688 | hhenkel | 2010-05-16 09:20:34 +0200 (Sun, 16 May 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/lua/lepdflib.cc fix DEBUG macros ------------------------------------------------------------------------

1 0

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 15 May '10

15 May '10

------------------------------------------------------------------------ r3687 | hhenkel | 2010-05-15 16:39:41 +0200 (Sat, 15 May 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/lua/ltexlib.c M /trunk/source/texk/web2c/luatexdir/tex/buildpage.w yet more fixes like the one from r3686 ------------------------------------------------------------------------

1 0

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 15 May '10

15 May '10

------------------------------------------------------------------------ r3686 | taco | 2010-05-15 07:55:38 +0200 (Sat, 15 May 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/tex/extensions.w fix initialization for xforms (from Hartmut) ------------------------------------------------------------------------

1 0

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 13 May '10

13 May '10

------------------------------------------------------------------------ r3685 | taco | 2010-05-13 09:37:47 +0200 (Thu, 13 May 2010) | 2 lines Changed paths: M /branches/0.60.x/source/texk/web2c/luatexdir/utils/synctex-luatex.h M /branches/0.60.x/source/texk/web2c/luatexdir/utils/synctex.c new synctex code from Jerome Laurens ------------------------------------------------------------------------

1 0

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 11 May '10

11 May '10

------------------------------------------------------------------------ r3682 | taco | 2010-05-11 10:07:11 +0200 (Tue, 11 May 2010) | 2 lines Changed paths: M /trunk/build.sh M /trunk/manual/luatexref-t.pdf M /trunk/manual/luatexref-t.tex M /trunk/source/texk/web2c/luatexdir/ChangeLog M /trunk/source/texk/web2c/luatexdir/NEWS M /trunk/source/texk/web2c/luatexdir/image/epdf.h M /trunk/source/texk/web2c/luatexdir/lua/loslibext.c M /trunk/source/texk/web2c/luatexdir/lua51/luaconf.h M /trunk/source/texk/web2c/luatexdir/luatex.c M /trunk/source/texk/web2c/luatexdir/tex/maincontrol.w merge pending 0.60.x changes ------------------------------------------------------------------------ r3683 | taco | 2010-05-11 10:15:33 +0200 (Tue, 11 May 2010) | 3 lines Changed paths: M /trunk Initialized merge tracking via "svnmerge" with revisions "1-3589" from http://foundry.supelec.fr/svn/luatex/branches/0.60.x ------------------------------------------------------------------------ r3684 | taco | 2010-05-11 10:29:33 +0200 (Tue, 11 May 2010) | 164 lines Changed paths: M /trunk Recorded merge of revisions 3591-3596,3598,3600,3602,3606,3609-3610,3612-3614,3618-3622,3628,3630-3631,3633-3634,3636-3638,3642-3645,3648-3651,3657,3659,3678 via svnmerge from http://foundry.supelec.fr/svn/luatex/branches/0.60.x ........ r3591 | taco | 2010-04-04 11:24:29 +0200 (Sun, 04 Apr 2010) | 2 lines oops, I forgot to update NEWS ........ r3592 | taco | 2010-04-04 16:00:55 +0200 (Sun, 04 Apr 2010) | 2 lines IPC fixes from TeXLive ........ r3593 | taco | 2010-04-05 08:21:13 +0200 (Mon, 05 Apr 2010) | 2 lines another git discovery patch, this time from Khaled Hosny ........ r3594 | taco | 2010-04-05 08:26:39 +0200 (Mon, 05 Apr 2010) | 2 lines The correct word is protrusion_skippabler not protrusion_skipable ........ r3595 | taco | 2010-04-05 12:06:54 +0200 (Mon, 05 Apr 2010) | 2 lines fix a typo spotted by Khaled and bump the version number ........ r3596 | taco | 2010-04-05 12:12:46 +0200 (Mon, 05 Apr 2010) | 2 lines fix assigning and aquiring \fontdimen s from TeX code ........ r3598 | taco | 2010-04-05 16:01:12 +0200 (Mon, 05 Apr 2010) | 2 lines luatex is not using texmfmp.h any more ........ r3600 | taco | 2010-04-07 16:21:51 +0200 (Wed, 07 Apr 2010) | 2 lines attempt to fix bug #372 ........ r3602 | taco | 2010-04-08 10:55:21 +0200 (Thu, 08 Apr 2010) | 2 lines attempt to fix \eqno/\leqno placements ........ r3606 | taco | 2010-04-10 14:58:25 +0200 (Sat, 10 Apr 2010) | 2 lines svn merge -r 3604:HEAD http://foundry.supelec.fr/svn/luatex/trunk . ........ r3609 | taco | 2010-04-11 17:10:43 +0200 (Sun, 11 Apr 2010) | 3 lines svn merge -r 3606:HEAD http://foundry.supelec.fr/svn/luatex/trunk . ........ r3610 | taco | 2010-04-12 19:18:13 +0200 (Mon, 12 Apr 2010) | 2 lines luatexdir changes from TL ........ r3612 | taco | 2010-04-13 11:29:42 +0200 (Tue, 13 Apr 2010) | 4 lines * add --warnings=[no|min|yes|max|all] option to build.sh * fix a bunch of compiler warnings resulting from that * restore use of swap_items() ........ r3613 | taco | 2010-04-13 11:59:11 +0200 (Tue, 13 Apr 2010) | 2 lines a few updates from texlive ........ r3614 | taco | 2010-04-13 18:45:00 +0200 (Tue, 13 Apr 2010) | 2 lines updated files from texlive, and autoreconf ........ r3618 | taco | 2010-04-15 07:54:45 +0200 (Thu, 15 Apr 2010) | 3 lines svn merge -r 3616:HEAD http://foundry.supelec.fr/svn/luatex/trunk ........ r3619 | taco | 2010-04-15 08:26:21 +0200 (Thu, 15 Apr 2010) | 2 lines updates from TL ........ r3620 | taco | 2010-04-15 16:43:11 +0200 (Thu, 15 Apr 2010) | 2 lines new configure.ac/c-auto.in/Makefile.am from TL + autoreconf ........ r3621 | taco | 2010-04-15 18:08:22 +0200 (Thu, 15 Apr 2010) | 2 lines fix handling of lua files with UNC names (hopefully) ........ r3622 | taco | 2010-04-15 18:19:37 +0200 (Thu, 15 Apr 2010) | 2 lines document os.selfdir ........ r3628 | taco | 2010-04-17 08:00:53 +0200 (Sat, 17 Apr 2010) | 2 lines add an extra linker switch to allow win32 exes to use 3G instead of 2G of virtual memory ........ r3630 | taco | 2010-04-19 20:52:02 +0200 (Mon, 19 Apr 2010) | 2 lines we don't need to load texmfmp-help.h ........ r3631 | taco | 2010-04-19 20:56:34 +0200 (Mon, 19 Apr 2010) | 2 lines remove externs, add actual headers ........ r3633 | taco | 2010-04-19 21:03:59 +0200 (Mon, 19 Apr 2010) | 2 lines no need to keep the mainbody alias anymore ........ r3634 | taco | 2010-04-19 21:52:48 +0200 (Mon, 19 Apr 2010) | 3 lines * include lib/lib.h instead of declaring setupboundvariable * add a few initializations to suppress warnings ........ r3636 | taco | 2010-04-20 15:31:45 +0200 (Tue, 20 Apr 2010) | 2 lines new updates from TL ........ r3637 | taco | 2010-04-20 15:44:56 +0200 (Tue, 20 Apr 2010) | 2 lines bump versions and news ........ r3638 | taco | 2010-04-20 16:00:47 +0200 (Tue, 20 Apr 2010) | 2 lines merge #3629 from trunk (was missed somehow) ........ r3642 | taco | 2010-04-21 09:52:13 +0200 (Wed, 21 Apr 2010) | 2 lines reinsert the -g -O2 CFLAGS while crosscompiling for macosx ........ r3643 | taco | 2010-04-21 10:08:18 +0200 (Wed, 21 Apr 2010) | 2 lines as mojca pointed out, --arch needs a different argument than -g ;) ........ r3644 | taco | 2010-04-23 18:35:00 +0200 (Fri, 23 Apr 2010) | 2 lines patch dealing with os.exec vs os.execute differences on Win32, from Tomek ........ r3645 | taco | 2010-04-23 21:00:42 +0200 (Fri, 23 Apr 2010) | 2 lines correct a bug in 3644 ........ r3648 | taco | 2010-04-24 10:04:50 +0200 (Sat, 24 Apr 2010) | 2 lines taco-is-an-idiot ........ r3649 | taco | 2010-04-24 15:06:56 +0200 (Sat, 24 Apr 2010) | 2 lines Retargetable cross compilation patch from Manuel P?\195?\169gouri?\195?\169-Gonnard ........ r3650 | taco | 2010-04-26 10:13:41 +0200 (Mon, 26 Apr 2010) | 2 lines header location fix from PEB (needed for a TL build system change) ........ r3651 | taco | 2010-04-27 11:57:40 +0200 (Tue, 27 Apr 2010) | 2 lines document tex.tprint() ........ r3657 | taco | 2010-04-28 08:32:19 +0200 (Wed, 28 Apr 2010) | 2 lines update news ........ r3659 | taco | 2010-04-28 17:10:32 +0200 (Wed, 28 Apr 2010) | 2 lines add \protected to an error message ........ r3678 | taco | 2010-05-06 10:46:53 +0200 (Thu, 06 May 2010) | 2 lines use __MINGW32__ instead of WIN32 (pointed out by PEB) ........ ------------------------------------------------------------------------

1 0