Re: [Dev-luatex] Memory leak in string.explode()?

7 Nov 2012

      On 11/7/2012 10:33 AM, luigi scarso wrote:
...
On Wed, Nov 7, 2012 at 10:07 AM, Hans Hagen mailto:pragma@wxs.nl> wrote:
On 11/7/2012 1:50 AM, Reinhard Kotucha wrote:
What I don't grok is why it's 20 times slower to load a file at once
        than in little chunks.  But what I'm mostly concerned about is
        memory
        consumption.  In xosview I can see that the garbage collector
        reduces
        the consumed memory from time to time, but it doesn't seem to be
        overly hungry.  Even worse, I have the impression that memory
        consumption grows exponentially with time.  With a slightly larger
        test file my system (4GB RAM) would certainly run out of memory.
I think 20 times is somewhat off at your end because here I get this:
Out of memory here  with a testfile of  662M
Linux 32bit, 4GByte, PAE extension
# time ./read_blocks.lua
real    0m2.458s
user    0m0.372s
sys    0m1.084s
# time ./read_whole_file.lua
not enough memory
real    0m17.125s
user    0m11.737s
sys    0m4.292s
# texlua -v
This is LuaTeX, Version beta-0.70.1-2012052416 (rev 4277)
Indeed not enough mem on my laptop for a 600M+ test.

Windows 8, 32 bit:

-- all      1.082   34176584    120272.328125
-- chunked  0.668   34176584    169908.59667969
-- once     1.065   34176584    111757.03710938

-- all      7.078   136706337   535063.34863281
-- chunked  3.441   136706337   787195.56933594
-- once     6.621   136706337   501559.83691406

the larger values for 'all' and 'once' still puzzle me.

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------