- dev-luatex - NTG Mailing Lists

luafontloader virtual access (bug #404, #448)
by Taco Hoekwater 10 Sep '10

10 Sep '10

Hi, It has been a busy day. On 09/05/2010 04:39 PM, taco(a)metatex.org wrote: > New Revision: 3857 > > Log: > add some virtual accessors to fontloader.open() return data Here is the relevant new section in the manual: %%% start manual As mentioned earlier, the return value of \type{fontloader.open()} is a userdata object. In \LUATEX\ versions before 0.63, the only way to have access to the actual metrics was to call \type{fontloader.to_table()} on this object, returning a table structure that is explained in the following subsections. However, it turns out that the result from \type{fontloader.to_table()} sometimes needs very large amounts of memory (depending on the font's complexity and size) so starting with \LUATEX\ 0.63, it will incrementally become possible to access the userdata object directly. In the \LUATEX\ 0.63.0, the following is implemented: \startitemize \item all top-level keys that would be returned by \type{to_table()} can also be accessed directly. \item the top-level key \quote{glyphs} returns a {\it virtual\/} array that allows indices from \type{0} to ($\type{f.glyphmax}-1$). \item the items in that virtual array (the actual glyphs) are themselves also userdata objects, and each has accessors for all of the keys explained in the section \quote{Glyph items} below. \item the top-level key \quote{subfonts} returns an {\it actual} array of userdata objects, one for each of the subfonts (or nil, if there are no subfonts). \stopitemize A short example may be helpful. This code generates a printout of all the glyph names in the font \type{PunkNova.kern.otf}: \starttyping local f = fontloader.open('PunkNova.kern.otf') print (f.fontname); local i = 0 while (i < f.glyphmax) do local g = f.glyphs[i] if g then print(g.name) end i = i + 1 end fontloader.close(f) \stoptyping In this case, the \LUATEX\ memory requirement stays below 100MB on the test computer, while the internal stucture generated by \type{to_table()} needs more than 2GB of memory (the font itself is 6.9MB in disk size). In \LUATEX\ 0.63 only the top-level font, the subfont table entries, and the glyphs are virtual objects, everything else still produces normal lua values and tables. In future versions, more return values will be replaced by userdata objects (as much as needed to keep the memory requirements in check). %%% end manual For course the memory savings will be less when more of the font information is used than just the glyph names, but it does seem to help quite a lot already (assuming the characters are converted into a metrics structure one at a time). The reason for this message is this: what are items that need to be virtualized, and which ones can easily be left alone? For example <glyph>.boundingbox returns an array of 4 integer numbers. It seems to me that it makes not that much sense to write a dedicated userdata object for such boundingboxes: the method call overhead will probably outweigh the gain from using less memory. On the other hand, <glyph>.kerns can be enormous (as it is in the punknova.kern case) and should probably be converted. Does anybody want to think about a shortlist of such items? Best wishes, Taco

3 8

test on node
by Patrick Gundlach 09 Sep '10

09 Sep '10

Hi, would it be (easily) possible to have a distinct kind of "type" for a node, for example: if type(myobject)=="node" then do whatever end could be of course tex.node or something else. Patrick

2 2

user_defined whatsits
by Patrick Gundlach 09 Sep '10

09 Sep '10

Hi, once in a while I find surprises in the luatex reference manual, such as the user_defined whatsits (great!). 1) Is the user_id field completely up to me? So I can use it somewhat as an attribute? 2) Will the user_defined whatsit stay in LuaTeX (I know, nothing is fixed, but the developers might have a tendency) 3) am I dreaming or is this really real? Patrick

3 7

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 09 Sep '10

09 Sep '10

------------------------------------------------------------------------ r3867 | taco | 2010-09-09 09:27:33 +0200 (Thu, 09 Sep 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/lang/texlang.w make hyphenation exceptions case-insensitive ------------------------------------------------------------------------ r3868 | taco | 2010-09-09 09:27:58 +0200 (Thu, 09 Sep 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/luafontloader/src/luafflib.c fix fontloader.fields() for cid subfonts ------------------------------------------------------------------------ r3869 | taco | 2010-09-09 09:32:24 +0200 (Thu, 09 Sep 2010) | 2 lines Changed paths: M /trunk/manual/luatexref-t.tex remove obsolete note about case sensitivity of exceptions ------------------------------------------------------------------------ r3870 | taco | 2010-09-09 09:41:26 +0200 (Thu, 09 Sep 2010) | 2 lines Changed paths: M /trunk/manual/luatexref-t.pdf M /trunk/manual/luatexref-t.tex update mplib section ------------------------------------------------------------------------ r3871 | taco | 2010-09-09 11:04:03 +0200 (Thu, 09 Sep 2010) | 2 lines Changed paths: M /trunk/manual/fdata.lua M /trunk/manual/functionref.pdf M /trunk/manual/functionref.tex update the short ref for 0.63 ------------------------------------------------------------------------ r3872 | taco | 2010-09-09 11:06:53 +0200 (Thu, 09 Sep 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/NEWS new news ------------------------------------------------------------------------ r3873 | taco | 2010-09-09 11:09:44 +0200 (Thu, 09 Sep 2010) | 5 lines Changed paths: A /tags/beta-0.63.0 (from /trunk:3872) --Tddddhis line, and those below, will be ignored-- qi A a http://foundry.supelec.fr/svn/luatex/tags/beta-0.63.0 ------------------------------------------------------------------------

1 0

Luatex 0.63.0 announcement
by Taco Hoekwater 09 Sep '10

09 Sep '10

Hi, I have just uploaded the archives for a new luatex release, 0.63.0. This is a development release. News: * Drop tex.ht[], tex.wd[], tex.dp[]. * Drop OCP support (and associated primitives). * Add tex.catcode[], tex.lccode[], tex.sfcode[], tex.uccode[], tex.mathcode[] and tex.delcode[] and associated functions. * Add CIDset tables to the output pdf where appropriate. * Added a 'string' field to late_lua nodes on the lua side. This field does not convert the assigned string to a tokenlist. * The result of fontloader.open() now has some virtual accessors (as well as fontloader.to_table). * There is now a `short reference' in the manual folder (functionref.pdf) Bugfixes: * Fix a crash on an empty font (bugreport #468). * Fix a crash for extremely long pattern arguments. * Fix a crash on bad virtual character arguments in lua. * Fix hyphenation exceptions. * Prevent linebreak between initial local_par paragraph whatsit and a following skip (bugreport #437). * Fix placement of scripts on textstyle big operators in MATH fonts (bugreport #466). * Fix a crash on the return value of MPlib's 'postscript' operation on images. * Fix a crash on \leftghost & \rightghost in math mode. The archives can be downloaded from supelec as usual: http://foundry.supelec.fr/gf/project/luatex/ You could also check out the sources via anonymous svn: svn co http://foundry.supelec.fr/svn/luatex/tags/beta-0.63.0 Bugs and feature requests can be added to the issue tracker at http://tracker.luatex.org Have fun, Taco

1 0

Documentation update/suggestion
by Graham Douglas 09 Sep '10

09 Sep '10

Hi Taco Firstly, thank you and the team for the continued stream of updates etc to LuaTeX. I was wondering if the mplib section of the LuaTeX Reference should be updated to reflect that the MPlib library no longer uses mem files --- according to a post you made recently: ------------- Perhaps it has something to do with the fact that luatex 0.61.0 uses mplib 1.502, which does not use actual mem files. Not only that, but at the moment basically only the 'ini_version' mode of mplib works, so the way to set up a mplib instance with a preloaded set of macros is like this (ignoring error testing): function newmpx (memname) local preamble = "let dump = endinput ; input %s ;" local mpx = mplib.new { ini_version = true, find_file = finder, -- change this as needed } return mpx:execute(string.format(preamble, memname)) end Code like this has been added to ConTeXt, but I do not know whether luamplib has caught up with that yet. Best wishes, Taco --------------------- I'd forgotten this until I recalled reading your post. An example with a simple finder function and a simple test graphic would I think be most welcome. Best wishes and thanks again for the continued and marvellous work of the LuaTeX team. Graham

2 1

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 08 Sep '10

08 Sep '10

------------------------------------------------------------------------ r3866 | taco | 2010-09-08 18:06:09 +0200 (Wed, 08 Sep 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/luafontloader/src/luafflib.c fix crashes in cidfonts by creating an extra userdata type (without __gc metamethod) ------------------------------------------------------------------------

1 0

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 08 Sep '10

08 Sep '10

------------------------------------------------------------------------ r3865 | taco | 2010-09-08 07:45:52 +0200 (Wed, 08 Sep 2010) | 5 lines Changed paths: M /trunk/manual/luatexref-t.pdf M /trunk/manual/luatexref-t.tex M /trunk/source/texk/web2c/luatexdir/luafontloader/src/luafflib.c remove the generation of 'automatic' glyph classes, and reword the documentation to remove the definitiveness of further conversion to userdata. ------------------------------------------------------------------------

1 0

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 07 Sep '10

07 Sep '10

svn: OPTIONS of 'http://foundry.supelec.fr/svn/luatex': could not connect to server (http://foundry.supelec.fr)

1 0

Cron <luatex@boekplan> /var/www/luatex.org/www/bin/luatex-svn
by root＠mail.boekplan.nl 07 Sep '10

07 Sep '10

------------------------------------------------------------------------ r3862 | taco | 2010-09-07 07:31:42 +0200 (Tue, 07 Sep 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/luafontloader/src/luafflib.c fix two cases of TEX_UNDEF in the virtual font accessors ------------------------------------------------------------------------ r3863 | taco | 2010-09-07 07:36:16 +0200 (Tue, 07 Sep 2010) | 2 lines Changed paths: M /trunk/source/texk/web2c/luatexdir/tex/commands.h M /trunk/source/texk/web2c/luatexdir/tex/maincontrol.w fix \leftghost and \rightghost in math mode ------------------------------------------------------------------------ r3864 | taco | 2010-09-07 09:26:43 +0200 (Tue, 07 Sep 2010) | 2 lines Changed paths: M /trunk/manual/luatexref-t.pdf M /trunk/manual/luatexref-t.tex M /trunk/source/texk/web2c/luatexdir/luafontloader/src/luafflib.c add fontloader.fields() function ------------------------------------------------------------------------

1 0