November 2009 - dev-luatex - NTG Mailing Lists

Snapshot 20070307
by Taco Hoekwater 10 May '12

10 May '12

Hi all, I decided to do a snapshot now instead of waiting for friday, because I want to start concentrating on something else besides font support issues. What's new: * Non-CID PostScript-based Opentype fonts are now combined over the entire document, and properly subsetted. The code is borrowed from xdvipdfmx with some minor adjustments Adding support for CID-keyed OpenType fonts would not be hard but at the moment I lack example input (and incentive). * A small extension to the virtual fonts structure: you can use f.fonts[1] = { 'id' = 38} to do a backreference to a previously defined font. This saves quite a few computations * There was a bug in the handling of \leaders in the output whereby it's width was taken to be twice what it should be while writing to the PDF, fixed now. * The font inclusion code is cleaned up a bit by Hartmut. * Some compilation problems were fixed. * There is (quite a bit of) debugging information printed out when OTPs are in use, because I am tracking down a bug reported by Idris. The input of each and every OTP step is shown on the terminal in a line line this: [57902][1568][58423][1568][58408][1568][58921] those are the decimal values of ocp i/o characters. If you don't need them, don't worry about it. Happy TeXing, Taco ----- Downloading and installation details: If you go to https://foundry.supelec.fr/frs/?group_id=10 you will see that there are three new released files: * luatex-snapshot-20070307.tar.bz2 This is the source tree. * luatex-snapshot-20070307-win32.zip A cross-compiled (mingw) windows binary. This is a web2c based binary, so it needs a texmf.cnf file (It will NOT work if you have only miktex installed). * luatex-snapshot-20070307-linux-i386.tar.bz2 An intel 32 linux binary (2.6.17)

3 2

Luatex 0.46.0 announcement
by Taco Hoekwater 12 Dec '09

12 Dec '09

Hi, I have just uploaded the archives for a new luatex release, 0.46.0. There are two important reason for this release: * It fixes an xform bug that is quite serious as it produces invalid pdf files (see below) * There is now experimental support for loading external .dll/.so files for lua extension modules. Copied from a message I sent to the dev-luatex list a few days ago: > I have committed an experimental patch that > enables dynamic loading for external compiled libraries unless --safer > is given on the command-line. > > It is experimental because: > > * it assumes that all architectures except windows will be happy with > using dlopen (windows has its own code which does not need compile- > time support, but you have to have an installed lua51.dll from e.g. > http://luabinaries.luaforge.net ). > > * I made only minimal changes to kpathsea. > > * there may be lua libraries out there that fail horribly. > > As with pure lua require() files, luatex will only use kpathsea if the > library is initialized already. > > kpathsea changes in detail: > > I added the kpse_clua_format identifier that searches for files with > extension .dll and .so. The texmf.cnf setting for this variable is > CLUAINPUTS, and by default it has this value: > > CLUAINPUTS=.:$SELFAUTOLOC/lib/{$progname,$engine,}/lua// > > This is the best I could do on short notice: the architecture has to > be in the path somewhere, and the fastest way to do that is to search > below the binary directory only. > > One level up (lib parallel to bin) would have been nicer, as the > context minimals have arch and bin swapped (texmf-linux/bin as opposed > to bin/i386-linux) but that would not have worked in texlive. If you know how to compile dynamic libraries on your platform, a good library to play with is Lua BitOp, http://bitop.luajit.org/ (single C source file and comes with a nice test lua script). And here is the normal list of features and bugfixes in 0.46.0 -------------------------------------------------------------- New features: * The build.sh script now has better support for new MacOSX-es (patch from Mojca). * Luatex now has experimental support for dynamic loading of external compiled lua libraries. Building luatex and loading external .so/.dll files is reported to work on Windows, linux and osx, other platforms are still unknown. * pdf.obj{type="stream"} no longer converts its argument to and from a tokenlist. This allows the use of binary data in the "string" argument. Such data does still have to hidden from the normal file parser by putting the code in a dofile() or by using string.char(), though. Bug fixes: * Luatex 0.45.0 was not able to find truetype nor opentype fonts if there were no callbacks defined (patch from Pawel). * 0.45.0 printed the user input instead of the full pathname for \input-ed tex files. * The TFM reader now rejects fonts with tfm names that are longer than 255 characters because such font names cannot be stored in a DVI file. * The combination of \immediate\pdfxform followed by a later \pdfrefxform could cause broken pdf output files because the box used for the form could have been freed and even reused already at that moment in time, sometimes resulting in an invalid transformation matrix. * The placement of super- and subscripts for displaystyle \int's in CambriaMath is now better than before. It still needs a tweak to the metrics though: in the current version, the italic correction has to be substracted from the width of the integral sign to get correct placement (context mkiv does this). to be continued ... The archives can be downloaded from supelec as usual: http://foundry.supelec.fr/gf/project/luatex/ You could also check out the sources via anonymous svn: svn co http://foundry.supelec.fr/svn/luatex/tags/beta-0.46.0 Bugs and feature requests can be added to the issue tracker at http://tracker.luatex.org Have fun, Taco

2 1

Cron <luatex@vz3> /var/www/luatex.org/www/bin/luatex-svn
by root＠www.metatex.org 30 Nov '09

30 Nov '09

------------------------------------------------------------------------ r3200 | taco | 2009-11-30 17:54:23 +0100 (Mon, 30 Nov 2009) | 2 lines Changed paths: M /trunk/source/libs/xpdf/xpdf-3.02/xpdf/PDFDoc.cc patch xpdf to prevent bug #294 ------------------------------------------------------------------------

1 0

Cron <luatex@vz3> /var/www/luatex.org/www/bin/luatex-svn
by root＠www.metatex.org 30 Nov '09

30 Nov '09

------------------------------------------------------------------------ r3199 | taco | 2009-11-30 14:25:17 +0100 (Mon, 30 Nov 2009) | 3 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/tex/maincontrol.c fix a bug for \lastbox in the presence of direction nodes (the direction nodes are now placed before the indentation box) ------------------------------------------------------------------------

1 0

Cron <luatex@vz3> /var/www/luatex.org/www/bin/luatex-svn
by root＠www.metatex.org 30 Nov '09

30 Nov '09

------------------------------------------------------------------------ r3198 | taco | 2009-11-30 11:47:37 +0100 (Mon, 30 Nov 2009) | 6 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/tex/postlinebreak.c Protruding can always run find_protchar_right these days, because the discretionaries are unfolded earlier. This is also a bugfix, because the pre-break text of a discretionary can end with a dir_node. ------------------------------------------------------------------------

1 0

Cron <luatex@vz3> /var/www/luatex.org/www/bin/luatex-svn
by root＠www.metatex.org 29 Nov '09

29 Nov '09

------------------------------------------------------------------------ r3196 | taco | 2009-11-29 11:54:29 +0100 (Sun, 29 Nov 2009) | 2 lines Changed paths: M /trunk/build.sh M /trunk/source/texk/web2c/luatexdir/lua/loslibext.c os.spawn patch for win32 from Tomek ------------------------------------------------------------------------ r3197 | taco | 2009-11-29 12:07:45 +0100 (Sun, 29 Nov 2009) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/tex/stringpool.h add lstring type ------------------------------------------------------------------------

1 0

os.spawn and argv[1] with sapces
by T T 29 Nov '09

29 Nov '09

Hi, I have encountered a problem with os.spawn(arg) on Windows. If arg[1]='foo bar' and arg[0]=nil, then the spawned process gets 'foo' as argv[0] and 'bar' as argv[1]. This might be expected, since according to docs, os.spawn doesn't do any argument processing. So I tried double quoting arg[1]='"foo bar"' (i.e. double quotes are part of arg[1]) but then os.spawn fails with invalid argument error. Is this expected? Furthermore, passing a string '"foo bar"' to os.spawn (including the double quotes) instead of a table, results in spawning 'foo bar' but again with 'foo' as argv[0] and 'bar' as argv[1]. The only way I found to properly spawn a command with spaces is by giving arg[0] explicitly: arg={[0]='foo bar', '"foo bar"', ...} Cheers, Tomek

6 17

Re: [Dev-luatex] [luatex 0000283]: PDF streams data should not be validated in UTF-8 regime
by Paweł Jackowski 26 Nov '09

26 Nov '09

Taco, let me discuss it here instead of reopening the issue. > I've decided not to attempt to fix this, there are too many tricky scanning > issues surrounding this. I understand that and I don't want to type explicit invalid UTF-8 strings. Nobody writes binary code from the keyboard I guess :) > If you want to create 8bit strings directly from > within a document, create you'll just have to build up the string > programmatically. The point is you actually *cannot* make that programmatically (lpdflib.c:406): if (!lua_isstring(L, -1)) /* !string-s t */ luaL_error(L, "pdf.obj(): \"string\" must be string for stream object"); So once you say pdf.obj{type = "stream", string = string.char(255)} pdf.obj("stream", string.char(255)) you don't use an explicit string, but you still get the error. As shown in note 0000309, moving the stuff to external file is not the complete solution either. Since binary streams are not likely to be valid UTF-8, using \pdfobj or pdf.obj() with "stream" keyword doesn't seem usable at all. But since we're not limited to strings, perhaps pdf stream data could be provided as: -- lua function returning the stream once called? pdf.obj{type = "stream", data = function() return string.char(255) end} -- array of integers representing bytes to be written? pdf.obj{type = "stream", data = {255}} Am I missing some workaround? How do you guys handle it in context? Regards, Paweł -- Pawe/l Jackowski P.Jackowski(a)gust.org.pl

4 7

Cron <luatex@vz3> /var/www/luatex.org/www/bin/luatex-svn
by root＠www.metatex.org 26 Nov '09

26 Nov '09

------------------------------------------------------------------------ r3192 | taco | 2009-11-26 15:14:10 +0100 (Thu, 26 Nov 2009) | 4 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/image/pdftoepdf.cc add a quick and dirty fix for pdfs generated by easyPDF Printer Driver 4.2, which uses full font dictionaries inside the Font resources instead of indirect references. ------------------------------------------------------------------------ r3193 | taco | 2009-11-26 15:16:59 +0100 (Thu, 26 Nov 2009) | 5 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/lua/lpdflib.c M /trunk/source/texk/web2c/luatexdir/pdf/pdfobj.c M /trunk/source/texk/web2c/luatexdir/tex/texnodes.c For pdf.obj(type='stream'), there is no need to go through a tokenlist. This patch sets obj_obj_is_stream and perhaps obj_obj_is_file to 2, which signals that obj_obj_data is a lua registry reference instead of a tokenlist. ------------------------------------------------------------------------ r3194 | taco | 2009-11-26 16:04:08 +0100 (Thu, 26 Nov 2009) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/NEWS M /trunk/source/texk/web2c/luatexdir/luatex.c bump the version and update NEWS for a new release ------------------------------------------------------------------------ r3195 | taco | 2009-11-26 16:06:47 +0100 (Thu, 26 Nov 2009) | 2 lines Changed paths: A /tags/beta-0.46.0 (from /trunk:3194) new tag ------------------------------------------------------------------------

1 0

build-latest-code-from-source instructions?
by D. R. Evans 26 Nov '09

26 Nov '09

I'm probably being blind, but I can't find any instructions about downloading the source from svn and building it. Can some kind person please point me to such instructions? I want to be sure I'm running current code before I file any "this works in pdftex but not in luatex" reports. Doc -- Web: http://www.sff.net/people/N7DR

7 17