MacTeX / ConTeXt: Very long compile times, cache rebuilds every time
Hello, Whenever I compile a document, it appears that mtxrun and simple fonts must rebuild/remake/generate every time. mtxrun starts off with: MTXrun | warning: source mismatch (luv: 144e2249a1a87cb1144311e3cfb4f0e1 <> bin: 40142b7d400e559a49cf2e9f12599280), forcing remake It appears to not throw errors about saving the cache. Just one example in hundreds: MTXrun | resolvers: preparing 'files' for '/usr/local/texlive/2010/texmf-dist' MTXrun | resolvers: category 'files', cachename '/usr/local/texlive/2010/texmf-dist' saved in '/Users/andrew/Library/texlive/2010/texmf-var/luatex-cache/context/210a81d6dcb1059dc80fab3f5470ab7a/trees/26993469c6208234eef0d0acf8456c4d.lua' It appears that this command tails with: MTXrun | format path: /Users/andrew/Library/texlive/2010/texmf-var/luatex-cache/context/210a81d6dcb1059dc80fab3f5470ab7a/formats MTXrun | resolvers: using given filetype 'tex' MTXrun | using tex source file: /usr/local/texlive/2010/texmf-dist/tex/context/base/cont-en.tex MTXrun | resolvers: using given filetype 'tex' MTXrun | resolvers: remembering file 'cont-en.lus' MTXrun | resolvers: qualified name '/usr/local/texlive/2010/texmf-dist/tex/context/base/cont-en.lus' Then luatex --ini begins: MTXrun | running command: luatex --ini --lua="/usr/local/texlive/2010/texmf-dist/tex/context/base/luat-cod.lua" "/usr/local/texlive/2010/texmf-dist/tex/context/base/cont-en.tex" \dump This is LuaTeX, Version beta-0.64.0-2010111215 (INITEX) \write18 enabled. It loads a great number of macros without error and tails with: Beginning to dump on file cont-en.fmt (format=cont-en 2010.11.18) 31667 strings using 410675 bytes 752503 memory locations dumped; current usage is 198&375520 29129 multiletter control sequences \font\nullfont=nullfont 0 preloaded fonts 0 words of pdf memory 7 indirect objects mkiv lua stats : used config file - /usr/local/texlive/2010/texmfcnf.lua;/usr/local/texlive/2010/texmf/web2c/texmfcnf.lua mkiv lua stats : used cache path - /Users/andrew/Library/texlive/2010/texmf-var/luatex-cache/context/210a81d6dcb1059dc80fab3f5470ab7a mkiv lua stats : input load time - 0.247 seconds mkiv lua stats : stored bytecode data - 229 modules, 54 tables, 283 chunks mkiv lua stats : node list callback tasks - 6 unique task lists, 2 instances (re)created, 6 calls mkiv lua stats : cleaned up reserved nodes - 0 nodes, 9 lists of 410 mkiv lua stats : node memory usage - 16 glue_spec mkiv lua stats : used backend - pdf (backend for directly generating pdf output) mkiv lua stats : callbacks - direct: 534, indirect: 117518, total: 118052 mkiv lua stats : result saved in file - cont-en.pdf mkiv lua stats : luatex banner - this is luatex, version beta-0.64.0-2010111215 mkiv lua stats : control sequences - 29129 of 65536 mkiv lua stats : current memory usage - 40 MB (ctx: 41 MB) mkiv lua stats : runtime - 24.292 seconds Then the document is processed and it goes quickly up until the end of this block: luatex --fmt="/Users/andrew/Library/texlive/2010/texmf-var/luatex-cache/context/210a81d6dcb1059dc80fab3f5470ab7a/formats/cont-en" --lua="/Users/andrew/Library/texlive/2010/texmf-var/luatex-cache/context/210a81d6dcb1059dc80fab3f5470ab7a/formats/cont-en.lui" --backend=pdf "/Users/andrew/Dropbox/Documentation/context/Excursion.tex"This is LuaTeX, Version beta-0.64.0-2010111215 \write18 enabled. sorters > setting language 'en' (/Users/andrew/Dropbox/Documentation/context/Excursion.tex jobcontrol > resuming randomizer with 0.74766131478719 publications : loading formatting style from bxml-apa (/usr/local/texlive/2010/texmf-dist/tex/context/base/bxml-apa.mkiv) ConTeXt ver: 2010.07.30 11:35 MKIV fmt: 2010.11.18 int: english/english system : cont-new loaded (/usr/local/texlive/2010/texmf-dist/tex/context/base/cont-new.tex systems : beware: some patches loaded from cont-new.tex (/usr/local/texlive/2010/texmf-dist/tex/context/base/cont-new.mkiv)) system : cont-fil loaded (/usr/local/texlive/2010/texmf-dist/tex/context/base/cont-fil.tex loading : ConTeXt File Synonyms ) system : cont-sys.rme loaded (/usr/local/texlive/2010/texmf-dist/tex/context/user/cont-sys.rme (/usr/local/texlive/2010/texmf-dist/tex/context/base/type-def.mkiv) (/usr/local/texlive/2010/texmf-dist/tex/context/base/type-lua.mkiv) (/usr/local/texlive/2010/texmf-dist/tex/context/base/type-siz.mkiv) (/usr/local/texlive/2010/texmf-dist/tex/context/base/type-otf.mkiv)) system : Excursion.top loaded (Excursion.top) fonts : preloading latin modern fonts {/usr/local/texlive/2010/texmf-dist/fonts/map/dvips/lm/lm-math.map}{/usr/local/texlive/2010/texmf-dist/fonts/map/dvips/lm/lm-rm.map}{/usr/local/texlive/2010/texmf-dist/fonts/map/pdftex/context/mkiv-base.map} bodyfont : 12pt rm is loaded language : language en is active system : module simplefonts loaded (/Users/andrew/src/texmf-trms/tex/context/third/simplefonts/t-simplefonts.tex loading : ConTeXt User Module / Simplefonts <+ /Users/andrew/src/texmf-trms/tex/context/third/simplefonts/t-simplefonts.lua>) fontnames > font database does not match configuration and file hashes fontnames > warnings are disabled (tracker 'fonts.warnings') fontnames > identifying tree font files with suffix otf =========================== here is where it goes on to rebuild the Simplefonts cache. It goes on happily, generating what appears to be well formed files in the directories it identifies. The last few pages of output are: fontnames > identifying system font files with suffix dfont fontnames > globbing path /Users/andrew/Library/Fonts/**.dfont fontnames > globbing path /Library/Fonts/**.dfont fontnames > globbing path /System/Library/Fonts/**.dfont fontnames > identifying system font files with suffix DFONT fontnames > globbing path /Users/andrew/Library/Fonts/**.DFONT fontnames > globbing path /Library/Fonts/**.DFONT fontnames > globbing path /System/Library/Fonts/**.DFONT fontnames > 11 system files identified, 0 skipped, 0 duplicates, 11 hash entries added, runtime 1.952 seconds fontnames > identifying system font files with suffix afm fontnames > globbing path /Users/andrew/Library/Fonts/**.afm fontnames > globbing path /Library/Fonts/**.afm fontnames > globbing path /System/Library/Fonts/**.afm fontnames > identifying system font files with suffix AFM fontnames > globbing path /Users/andrew/Library/Fonts/**.AFM fontnames > globbing path /Library/Fonts/**.AFM fontnames > globbing path /System/Library/Fonts/**.AFM fontnames > 0 system files identified, 0 skipped, 0 duplicates, 0 hash entries added, runtime 0.123 seconds fontnames > 418 files rejected due to clashes fontnames > 513 double lookups in mappings fontnames > 10 double lookups in fallbacks report | lua: compiling /Users/andrew/Library/texlive/2010/texmf-var/luatex-cache/context/210a81d6dcb1059dc80fab3f5470ab7a/fonts/data/names.tma into /Users/andrew/Library/texlive/2010/texmf-var/luatex-cache/context/210a81d6dcb1059dc80fab3f5470ab7a/fonts/data/names.tmc systems : begin file /Users/andrew/Dropbox/Documentation/context/Excursion.tex at line 79 (/usr/local/texlive/2010/texmf-dist/tex/context/base/page-run.mkii loading : ConTeXt Page Macros / Runtime Macros ) pages > flushing realpage 1, userpage 1, subpage 1 pages > flushing realpage 2, userpage 2 pages > flushing realpage 3, userpage 3 pages > flushing realpage 4, userpage 4 (/usr/local/texlive/2010/texmf-dist/tex/context/sample/knuth.tex) (/usr/local/texlive/2010/texmf-dist/tex/context/sample/knuth.tex) (/usr/local/texlive/2010/texmf-dist/tex/context/sample/knuth.tex) (/usr/local/texlive/2010/texmf-dist/tex/context/sample/knuth.tex pages > flushing realpage 5, userpage 5 ) (/usr/local/texlive/2010/texmf-dist/tex/context/sample/knuth.tex) (/usr/local/texlive/2010/texmf-dist/tex/context/sample/knuth.tex) (/usr/local/texlive/2010/texmf-dist/tex/context/sample/knuth.tex pages > flushing realpage 6, userpage 6 ) (/usr/local/texlive/2010/texmf-dist/tex/context/sample/knuth.tex) (/usr/local/texlive/2010/texmf-dist/tex/context/sample/knuth.tex) (/usr/local/texlive/2010/texmf-dist/tex/context/sample/knuth.tex pages > flushing realpage 7, userpage 7 ) pages > flushing realpage 8, userpage 8 systems : end file /Users/andrew/Dropbox/Documentation/context/Excursion.tex at line 88 system : cont-err loaded (/usr/local/texlive/2010/texmf-dist/tex/context/base/cont-err.tex systems : no file 'cont-sys.tex', using 'cont-sys.rme' instead ) ) mkiv lua stats : used config file - /usr/local/texlive/2010/texmfcnf.lua;/usr/local/texlive/2010/texmf/web2c/texmfcnf.lua mkiv lua stats : used cache path - /Users/andrew/Library/texlive/2010/texmf-var/luatex-cache/context/210a81d6dcb1059dc80fab3f5470ab7a mkiv lua stats : input load time - 2.085 seconds mkiv lua stats : stored bytecode data - 231 modules, 54 tables, 285 chunks mkiv lua stats : loaded tex modules - 1 requested, 1 found (*-simplefonts), 0 missing mkiv lua stats : node list callback tasks - 6 unique task lists, 5 instances (re)created, 2656 calls mkiv lua stats : cleaned up reserved nodes - 39 nodes, 11 lists of 410 mkiv lua stats : node memory usage - 21 glue_spec mkiv lua stats : h-node processing time - 0.310 seconds including kernel mkiv lua stats : attribute processing time - 0.104 seconds front- and backend mkiv lua stats : used backend - pdf (backend for directly generating pdf output) mkiv lua stats : loaded patterns - en::2 mkiv lua stats : language load time - 0.090 seconds , nofpatterns: 1 mkiv lua stats : callbacks - direct: 3616, indirect: 5894, total: 9510 mkiv lua stats : lxml preparation time - 0.000 seconds, 0 nodes, 15 lpath calls, 0 cached calls mkiv lua stats : result saved in file - Excursion.pdf mkiv lua stats : loaded fonts - 40 files: minionpro-regular.otf stmary10.afm lmmono10-regular.otf lmmono12-regular.otf lmmono8-regular.otf lmmono9-regular.otf lmroman10-bold.otf lmroman10-regular.otf lmroman12-bold.otf lmroman12-regular.otf lmroman7-bold.otf lmroman7-regular.otf lmroman9-bold.otf lmroman9-regular.otf lmsans10-regular.otf lmsans12-regular.otf lmsans8-regular.otf lmsans9-regular.otf eufb10.tfm eufb7.tfm eufm10.tfm eufm7.tfm msam10.tfm msam7.tfm msbm10.tfm msbm7.tfm lmex10.tfm lmmi10.tfm lmmi12.tfm lmmi7.tfm lmmi9.tfm lmmib10.tfm lmmib7.tfm lmsy10.tfm lmsy7.tfm lmsy9.tfm rm-lmr10.tfm rm-lmr12.tfm rm-lmr7.tfm rm-lmr9.tfm mkiv lua stats : fonts load time - 5.098 seconds mkiv lua stats : luatex banner - this is luatex, version beta-0.64.0-2010111215 mkiv lua stats : control sequences - 32688 of 165536 mkiv lua stats : current memory usage - 92 MB (ctx: 94 MB) mkiv lua stats : runtime - 148.526 seconds, 7 processed pages, 8 shipped pages, 0.054 pages/second MTXrun | total runtime: 256.380 Is there something that I can do? I already tried to "chown <myname> -R /usr/local/texlive/2010" That didn't have any effect and I didn't think it would... I'm running tlcontrib install with MacTeX 2010. Thanks! Best Regards, Andrew Starks Tightrope Media Systems Co-Founder 800 Transfer Road, Suite 1B, Saint Paul MN 55114 866 866-4118, 201
On Thu, Nov 18, 2010 at 12:22 PM, Andrew Starks
Hello,
Whenever I compile a document, it appears that mtxrun and simple fonts must rebuild/remake/generate every time. mtxrun starts off with: Uh, this is the same problem that I have when I cross-compile luatex under linux for windows32. Strange enough that it happens with Mac too.
-- luigi
On 11/18/2010 12:30 PM, luigi scarso wrote:
On Thu, Nov 18, 2010 at 12:22 PM, Andrew Starks
wrote: Hello,
Whenever I compile a document, it appears that mtxrun and simple fonts must rebuild/remake/generate every time. mtxrun starts off with: Uh, this is the same problem that I have when I cross-compile luatex under linux for windows32. Strange enough that it happens with Mac too.
both problems come from bad TEXMFCACHE settings. Please search back through the mailing list archives, this problem has been discussed not so long ago.
On 11/18/2010 12:30 PM, luigi scarso wrote:
On Thu, Nov 18, 2010 at 12:22 PM, Andrew Starks
wrote: Hello,
Whenever I compile a document, it appears that mtxrun and simple fonts must rebuild/remake/generate every time. mtxrun starts off with:
Uh, this is the same problem that I have when I cross-compile luatex under linux for windows32. Strange enough that it happens with Mac too.
both problems come from bad TEXMFCACHE settings. Please search back through the mailing list archives, this problem has been discussed not so long ago. My experience on windows32 mkiv is that changing the default luatex with my cross-compiled exe (gnu gcc 4.1 if I remember correctly)
On Thu, Nov 18, 2010 at 12:33 PM, Taco Hoekwater
On 18-11-2010 12:22, Andrew Starks wrote:
Hello,
Whenever I compile a document, it appears that mtxrun and simple fonts must rebuild/remake/generate every time. mtxrun starts off with:
can you check if texlua and luatex are the same binaries? ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com | www.pragma-pod.nl -----------------------------------------------------------------
On Thu, Nov 18, 2010 at 12:48 PM, Hans Hagen
On 18-11-2010 12:22, Andrew Starks wrote:
Hello,
Whenever I compile a document, it appears that mtxrun and simple fonts must rebuild/remake/generate every time. mtxrun starts off with:
can you check if texlua and luatex are the same binaries? me stupid....
-- luigi
On Thu, Nov 18, 2010 at 12:50 PM, luigi scarso
On Thu, Nov 18, 2010 at 12:48 PM, Hans Hagen
wrote: On 18-11-2010 12:22, Andrew Starks wrote:
Hello,
Whenever I compile a document, it appears that mtxrun and simple fonts must rebuild/remake/generate every time. mtxrun starts off with:
can you check if texlua and luatex are the same binaries? me stupid.... OK, now I have the same binaries but a "engine mismatch":
MTXrun | warning: engine mismatch (luv: This is LuaTeX, Version beta-0.64.0-2010111618 (rev 3961) <> bin: This is LuaTe , Version beta-0.64.0-2010111223 (Web2C 2010) (rev 3956)), forcing remake MTXrun | resolvers: loading configuration file 'c:/luatex/minimals-beta/context/tex/texmf/web2c/texmfcnf.lua' rev 3961 is mine , rev 3956 is the canonical one I'm bit confused, it seems windows-only stuff -- luigi
On 18-11-2010 5:13, luigi scarso wrote:
OK, now I have the same binaries but a "engine mismatch":
MTXrun | warning: engine mismatch (luv: This is LuaTeX, Version beta-0.64.0-2010111618 (rev 3961)<> bin: This is LuaTe , Version beta-0.64.0-2010111223 (Web2C 2010) (rev 3956)), forcing remake MTXrun | resolvers: loading configuration file 'c:/luatex/minimals-beta/context/tex/texmf/web2c/texmfcnf.lua'
looks like they're not the same how about making copies: copy luatex.exe to texlua.exe and texluac.exe ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com | www.pragma-pod.nl -----------------------------------------------------------------
On Thu, Nov 18, 2010 at 5:31 PM, Hans Hagen
On 18-11-2010 5:13, luigi scarso wrote:
OK, now I have the same binaries but a "engine mismatch":
MTXrun | warning: engine mismatch (luv: This is LuaTeX, Version beta-0.64.0-2010111618 (rev 3961)<> bin: This is LuaTe , Version beta-0.64.0-2010111223 (Web2C 2010) (rev 3956)), forcing remake MTXrun | resolvers: loading configuration file 'c:/luatex/minimals-beta/context/tex/texmf/web2c/texmfcnf.lua'
looks like they're not the same
how about making copies: copy luatex.exe to texlua.exe and texluac.exe Already done
Directory di c:\luatex\minimals-beta\context\tex\texmf-mswin\bin 16/11/2010 19:09 4.906.496 luatex.exe Directory di c:\luatex\minimals-beta\context\tex\texmf-mswin\bin 16/11/2010 19:09 4.906.496 texlua.exe Directory di c:\luatex\minimals-beta\context\tex\texmf-mswin\bin 16/11/2010 19:09 4.906.496 texluac.exe -- luigi
On Thu, Nov 18, 2010 at 5:38 PM, luigi scarso
On Thu, Nov 18, 2010 at 5:31 PM, Hans Hagen
wrote: On 18-11-2010 5:13, luigi scarso wrote:
OK, now I have the same binaries but a "engine mismatch":
MTXrun | warning: engine mismatch (luv: This is LuaTeX, Version beta-0.64.0-2010111618 (rev 3961)<> bin: This is LuaTe , Version beta-0.64.0-2010111223 (Web2C 2010) (rev 3956)), forcing remake MTXrun | resolvers: loading configuration file 'c:/luatex/minimals-beta/context/tex/texmf/web2c/texmfcnf.lua'
looks like they're not the same
how about making copies: copy luatex.exe to texlua.exe and texluac.exe Already done
Directory di c:\luatex\minimals-beta\context\tex\texmf-mswin\bin
16/11/2010 19:09 4.906.496 luatex.exe
Directory di c:\luatex\minimals-beta\context\tex\texmf-mswin\bin
16/11/2010 19:09 4.906.496 texlua.exe
Directory di c:\luatex\minimals-beta\context\tex\texmf-mswin\bin
16/11/2010 19:09 4.906.496 texluac.exe It seems that I need also to delete luatex.dll Doing so all things go well
-- luigi
On Thu, Nov 18, 2010 at 11:18 AM, luigi scarso
It seems that I need also to delete luatex.dll Doing so all things go well
-- luigi ___________________________________________________________________________________
Wish I had a luatex.dll to delete. :( ;) -Andrew
On Fri, Nov 19, 2010 at 3:11 AM, Andrew Starks
On Thu, Nov 18, 2010 at 11:18 AM, luigi scarso
wrote: It seems that I need also to delete luatex.dll Doing so all things go well
-- luigi ___________________________________________________________________________________
Wish I had a luatex.dll to delete. :(
;) yours
MTXrun | warning: source mismatch (luv: 144e2249a1a87cb1144311e3cfb4f0e1 <> bin: 40142b7d400e559a49cf2e9f12599280), forcing remake was almost the same of mine. It says "I (mtxrun) have found that the luatex that built the format is luv: 144e2249a1a87cb1144311e3cfb4f0e1 while currently I will use the luatex bin:40142b7d400e559a49cf2e9f12599280 They are different so I must rebuild the format." "luv" comes from the cache --- perhaps a wrong TEXMFCACHE ? "bin" coms from "executables" luatex files (under windows exe and dll) --- are you sure that you have the same luatex in you system ? I don't know the story under Mac, but if it's like Linux that you should have only programs. -- luigi
On 11/19/2010 06:52 AM, luigi scarso wrote:
"luv" comes from the cache --- perhaps a wrong TEXMFCACHE ?
Almost certainly. There was a MacTeX 'special' version of texmfcnf.lua, and that needs adjusting for the latest luatex / context combo. I am not quite sure what the best email thread is to link to, but I know that there have been other posts and people managed to actually make this work. Mojca perhaps? Best wishes, Taco
Ack. Of course, it's my fault. :)
TEXCACHE != TEXVAR
Best Regards,
Andrew Starks
Tightrope Media Systems
Co-Founder
800 Transfer Road, Suite 1B, Saint Paul MN 55114
866 866-4118, 201
On Fri, Nov 19, 2010 at 3:20 AM, Taco Hoekwater
On 11/19/2010 06:52 AM, luigi scarso wrote:
"luv" comes from the cache --- perhaps a wrong TEXMFCACHE ?
Almost certainly. There was a MacTeX 'special' version of texmfcnf.lua, and that needs adjusting for the latest luatex / context combo. I am not quite sure what the best email thread is to link to, but I know that there have been other posts and people managed to actually make this work. Mojca perhaps?
Best wishes, Taco ___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki!
maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context webpage : http://www.pragma-ade.nl / http://tex.aanhet.net archive : http://foundry.supelec.fr/projects/contextrev/ wiki : http://contextgarden.net ___________________________________________________________________________________
participants (4)
-
Andrew Starks
-
Hans Hagen
-
luigi scarso
-
Taco Hoekwater