Memory consumption in new upload - ntg-context - NTG Mailing Lists

Memory consumption in new upload

older
Problem with wiki example

Shiv Shankar Dayal

17 Feb 2024 17 Feb '24

5:17 p.m.

Thanks for new upload. I see that memory consumption is much less than previous version. So once again, thanks a lot. I am curious about what has changed in recent upload, that memory consumption is about 60% of earlier versions. -- Respect, Shiv Shankar Dayal

Attachments:

attachment.html (text/html — 512 bytes)

Reply

Sign in to reply online Use email software

Show replies by date

Hans Hagen

17 Feb 17 Feb

8:39 p.m.

On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote:

Thanks for new upload. I see that memory consumption is much less than previous version. So once again, thanks a lot.

I am curious about what has changed in recent upload, that memory consumption is about 60% of earlier versions. it's hard to tell what exact consumpiton is becaue for instance when lua creates tables, they grow by factors two when then have to (maybe 5.5 is a bit less consuming)

on the one hand luametatex is more efficient than luatex due to all kind of ímprovements' but some nodes are larger so that takes more memory, which is only noticed when one has lots of text on a page (or keeps boxes stuff around) anyway, not that much changed since the previous upload, so maybe you just stay below a threshold I recently generated a 180MB document with 2500 fonts + metapost outlines of them and that could bump mem usage (with empty cache) to 30 GB (less after fonts were cached) but normally we stay around 125 MB for a document. Anyway, tex mem consumption can often be neglected compared to other applications. Hans ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl -----------------------------------------------------------------

Reply

Sign in to reply online Use email software

Shiv Shankar Dayal

9:42 p.m.

The only change I made was that I started using a 9pt modern font than a 10 pt modern font. My document decreased from 580+ pages to 500 pages after that. About your document, I assume you had a lot of Graphics because text only 180MB is too high. I have only few diagrams and my file size is only 3MB. On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen wrote:

On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote:

...
Thanks for new upload. I see that memory consumption is much less than previous version. So once again, thanks a lot.

I am curious about what has changed in recent upload, that memory consumption is about 60% of earlier versions. it's hard to tell what exact consumpiton is becaue for instance when lua creates tables, they grow by factors two when then have to (maybe 5.5 is a bit less consuming)

on the one hand luametatex is more efficient than luatex due to all kind of ímprovements' but some nodes are larger so that takes more memory, which is only noticed when one has lots of text on a page (or keeps boxes stuff around)

anyway, not that much changed since the previous upload, so maybe you just stay below a threshold

I recently generated a 180MB document with 2500 fonts + metapost outlines of them and that could bump mem usage (with empty cache) to 30 GB (less after fonts were cached) but normally we stay around 125 MB for a document. Anyway, tex mem consumption can often be neglected compared to other applications.

Hans

----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl -----------------------------------------------------------------

___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl webpage : https://www.pragma-ade.nl / https://context.aanhet.net (mirror) archive : https://github.com/contextgarden/context wiki : https://wiki.contextgarden.net

___________________________________________________________________________________

-- Respect, Shiv Shankar Dayal

Reply

Sign in to reply online Use email software

Shiv Shankar Dayal

9:50 p.m.

I assume you would have created typescripts for those fonts. Can you please add them to ConTeXt distribution, at least for the popular fonts? On Sun, Feb 18, 2024 at 3:12 AM Shiv Shankar Dayal < shivshankar.dayal@gmail.com> wrote:

The only change I made was that I started using a 9pt modern font than a 10 pt modern font.

My document decreased from 580+ pages to 500 pages after that.

About your document, I assume you had a lot of Graphics because text only 180MB is too high. I have only few diagrams and my file size is only 3MB.

On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen wrote:

...
On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote:

...
Thanks for new upload. I see that memory consumption is much less than previous version. So once again, thanks a lot.

I am curious about what has changed in recent upload, that memory consumption is about 60% of earlier versions. it's hard to tell what exact consumpiton is becaue for instance when lua creates tables, they grow by factors two when then have to (maybe 5.5 is a bit less consuming)

on the one hand luametatex is more efficient than luatex due to all kind of ímprovements' but some nodes are larger so that takes more memory, which is only noticed when one has lots of text on a page (or keeps boxes stuff around)

anyway, not that much changed since the previous upload, so maybe you just stay below a threshold

I recently generated a 180MB document with 2500 fonts + metapost outlines of them and that could bump mem usage (with empty cache) to 30 GB (less after fonts were cached) but normally we stay around 125 MB for a document. Anyway, tex mem consumption can often be neglected compared to other applications.

Hans

----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl -----------------------------------------------------------------

___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl webpage : https://www.pragma-ade.nl / https://context.aanhet.net (mirror) archive : https://github.com/contextgarden/context wiki : https://wiki.contextgarden.net

___________________________________________________________________________________

-- Respect, Shiv Shankar Dayal

-- Respect, Shiv Shankar Dayal

Reply

Sign in to reply online Use email software

Hans Hagen

10:41 p.m.

On 2/17/2024 10:50 PM, Shiv Shankar Dayal wrote:

I assume you would have created typescripts for those fonts. Can you please add them to ConTeXt distribution, at least for the popular fonts?

Many of those are covered by typescripts. Those that are not, are on my machine because we needed them (often long ago) for a project (these are commercial fonts, in most cases typeone and of such a collection actually a few were used then). There are also some commercial fonts that I got for free. Then there are fonts that I have to check because users had an issue (public ones, of different quality and useability). Of those 'trying to cover all of unicode with different fonts of the same design' I tested subsets. And of course the fonts that come with the operating system (basically all fonts that context can access during a run). We're not going to make typescripts for every combination as in practice for most documents one needs a single setup and therefore only a handful of lines of code (and likely use some typescript file for a math font). There's also the selectfont mechanism that uses heuristics to do the same. There are plenty of examples in the distribution and for a specific style that demands certain fonts one can also put the definitions in the style.

On Sun, Feb 18, 2024 at 3:12 AM Shiv Shankar Dayal mailto:shivshankar.dayal@gmail.com> wrote:

The only change I made was that I started using a 9pt modern font than a 10 pt modern font.

My document decreased from 580+ pages to 500 pages after that.

About your document, I assume you had a lot of Graphics because text only 180MB is too high. I have only few diagrams and my file size is only 3MB.

On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen mailto:j.hagen@xs4all.nl> wrote:

On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote: > Thanks for new upload. I see that memory consumption is much less than > previous version. So > once again, thanks a lot. > > I am curious about what has changed in recent upload, that memory > consumption is about 60% of earlier versions. it's hard to tell what exact consumpiton is becaue for instance when lua creates tables, they grow by factors two when then have to (maybe 5.5 is a bit less consuming)

on the one hand luametatex is more efficient than luatex due to all kind of ímprovements' but some nodes are larger so that takes more memory, which is only noticed when one has lots of text on a page (or keeps boxes stuff around)

anyway, not that much changed since the previous upload, so maybe you just stay below a threshold

I recently generated a 180MB document with 2500 fonts + metapost outlines of them and that could bump mem usage (with empty cache) to 30 GB (less after fonts were cached) but normally we stay around 125 MB for a document. Anyway, tex mem consumption can often be neglected compared to other applications.

Hans

----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | www.pragma-ade.nl http://www.pragma-ade.nl | www.pragma-pod.nl http://www.pragma-pod.nl -----------------------------------------------------------------

___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl mailto:ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl webpage : https://www.pragma-ade.nl https://www.pragma-ade.nl / https://context.aanhet.net https://context.aanhet.net (mirror) archive : https://github.com/contextgarden/context https://github.com/contextgarden/context wiki : https://wiki.contextgarden.net https://wiki.contextgarden.net ___________________________________________________________________________________

-- Respect, Shiv Shankar Dayal

-- Respect, Shiv Shankar Dayal

___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl webpage : https://www.pragma-ade.nl / https://context.aanhet.net (mirror) archive : https://github.com/contextgarden/context wiki : https://wiki.contextgarden.net ___________________________________________________________________________________

-- ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl -----------------------------------------------------------------

Reply

Sign in to reply online Use email software

309

Age (days ago)

309

Last active (days ago)

Download

4 comments

2 participants

tags

participants (2)

Hans Hagen
Shiv Shankar Dayal