reproducibility issue of pdf inclusion of LuaTeX 1.09.0
Hi, I'm suffering from reproducibility issue of pdf inclusion of LuaTeX. The output file size differs from time to time, and the largest one is more than twice of the smallest one! Please find the attached 20181203-luatex-pdfobj.tar.xz ======== Details: ======== My binaries are based on TeX Live svn r49302 (self-build on macOS) and I am using LuaTeX with Lua5.2: $ luatex --version This is LuaTeX, Version 1.09.0 (TeX Live 2019/dev) [.. snip ..] LuaTeX is Copyright 2018 Taco Hoekwater and the LuaTeX Team. With the attached source, I run $ export SOURCE_DATE_EPOCH=0 $ export FORCE_SOURCE_DATE=1 $ for i in `seq 0 256`; do lualatex -jobname=include-$i include; done (SOURCE_DATE_EPOCH and FORCE_SOURCE_DATE are set above, to ensure that all output binaries are expected to be identical) The output file (include-[num].pdf) sizes differ from time to time as follows: [size] - [frequency] 63928 bytes - 230 63947 bytes - 1 63958 bytes - 1 110923 bytes - 2 110924 bytes - 10 110925 bytes - 2 110928 bytes - 1 110931 bytes - 1 110932 bytes - 1 110935 bytes - 7 157913 bytes - 1 The largest one is more than twice of the smallest one (= the most frequent one)! Attached are some representatives, and I noticed that the log files also show some strange difference of object numbers: * include-0: 63928 bytes PDF statistics: 72 PDF objects out of 1000 (max. 8388607) 36 compressed objects within 1 object stream * include-11: 110924 bytes PDF statistics: 86 PDF objects out of 1000 (max. 8388607) 44 compressed objects within 1 object stream * include-201: 158913 bytes PDF statistics: 100 PDF objects out of 1000 (max. 8388607) 52 compressed objects within 1 object stream I never experienced this kind of difference with LuaTeX 1.07.0 of TeX Live 2018. Could you examine this issue? Thanks -- Hironobu ---- 山下 弘展 (Hironobu Yamashita) e-mail: h.y.acetaminophen@gmail.com
Hi,
I'm suffering from reproducibility issue of pdf inclusion of LuaTeX. The output file size differs from time to time, and the largest one is more than twice of the smallest one!
FWIW, I also tested with the newer LuaTeX (experimental, r7008) This is LuaTeX, Version 1.09.1 (TeX Live 2019/dev) and I got a similar result. Hironobu
On Mon, Dec 3, 2018 at 2:50 PM Hironobu Yamashita < h.y.acetaminophen@gmail.com> wrote:
Hi,
I'm suffering from reproducibility issue of pdf inclusion of LuaTeX. The output file size differs from time to time, and the largest one is more than twice of the smallest one!
FWIW, I also tested with the newer LuaTeX (experimental, r7008)
This is LuaTeX, Version 1.09.1 (TeX Live 2019/dev)
and I got a similar result.
Here I have %% include.mkiv \starttext \externalfigure[img.pdf] \stoptext %% do.sh export SOURCE_DATE_EPOCH=0 export FORCE_SOURCE_DATE=1 context --purgeall for i in `seq 0 20`; do context --nodates include.mkiv 1>/dev/null; cp -v include.pdf include-$i.pdf done md5sum include-*pdf $ bash do.sh 'include.pdf' -> 'include-0.pdf' 'include.pdf' -> 'include-1.pdf' 'include.pdf' -> 'include-2.pdf' 'include.pdf' -> 'include-3.pdf' 'include.pdf' -> 'include-4.pdf' 'include.pdf' -> 'include-5.pdf' 'include.pdf' -> 'include-6.pdf' 'include.pdf' -> 'include-7.pdf' 'include.pdf' -> 'include-8.pdf' 'include.pdf' -> 'include-9.pdf' 'include.pdf' -> 'include-10.pdf' 'include.pdf' -> 'include-11.pdf' 'include.pdf' -> 'include-12.pdf' 'include.pdf' -> 'include-13.pdf' 'include.pdf' -> 'include-14.pdf' 'include.pdf' -> 'include-15.pdf' 'include.pdf' -> 'include-16.pdf' 'include.pdf' -> 'include-17.pdf' 'include.pdf' -> 'include-18.pdf' 'include.pdf' -> 'include-19.pdf' 'include.pdf' -> 'include-20.pdf' c1dfdcda341fedf4eea0b608767687f0 include-0.pdf c1dfdcda341fedf4eea0b608767687f0 include-10.pdf c1dfdcda341fedf4eea0b608767687f0 include-11.pdf c1dfdcda341fedf4eea0b608767687f0 include-12.pdf c1dfdcda341fedf4eea0b608767687f0 include-13.pdf c1dfdcda341fedf4eea0b608767687f0 include-14.pdf c1dfdcda341fedf4eea0b608767687f0 include-15.pdf c1dfdcda341fedf4eea0b608767687f0 include-16.pdf c1dfdcda341fedf4eea0b608767687f0 include-17.pdf c1dfdcda341fedf4eea0b608767687f0 include-18.pdf c1dfdcda341fedf4eea0b608767687f0 include-19.pdf c1dfdcda341fedf4eea0b608767687f0 include-1.pdf c1dfdcda341fedf4eea0b608767687f0 include-20.pdf c1dfdcda341fedf4eea0b608767687f0 include-2.pdf c1dfdcda341fedf4eea0b608767687f0 include-3.pdf c1dfdcda341fedf4eea0b608767687f0 include-4.pdf c1dfdcda341fedf4eea0b608767687f0 include-5.pdf c1dfdcda341fedf4eea0b608767687f0 include-6.pdf c1dfdcda341fedf4eea0b608767687f0 include-7.pdf c1dfdcda341fedf4eea0b608767687f0 include-8.pdf c1dfdcda341fedf4eea0b608767687f0 include-9.pdf This is LuaTeX, Version 1.09.1 (TeX Live 2019/dev) Development id: 7008 The size is 53011 bytes . -- luigi
Hi Luiji, %% include.mkiv
\starttext \externalfigure[img.pdf] \stoptext
The size is 53011 bytes .
Sorry I don't know much about context, but what happens when different pages of image.pdf are included into the same file as I do in my lualatex source? -- hironobu -- ---- 山下 弘展 (Hironobu Yamashita) e-mail: h.y.acetaminophen@gmail.com
On Mon, Dec 3, 2018 at 4:58 PM Hironobu Yamashita < h.y.acetaminophen@gmail.com> wrote:
Hi Luiji,
%% include.mkiv
\starttext \externalfigure[img.pdf] \stoptext
The size is 53011 bytes .
Sorry I don't know much about context, but what happens when different pages of image.pdf are included into the same file as I do in my lualatex source?
we are looking into it. -- luigi
On Tue, Dec 4, 2018 at 10:55 AM luigi scarso
On Mon, Dec 3, 2018 at 4:58 PM Hironobu Yamashita < h.y.acetaminophen@gmail.com> wrote:
Hi Luiji,
%% include.mkiv
\starttext \externalfigure[img.pdf] \stoptext
The size is 53011 bytes .
Sorry I don't know much about context, but what happens when different pages of image.pdf are included into the same file as I do in my lualatex source?
we are looking into it. -- luigi
We have just committed revision 7010 that should fix the issue. -- luigi
On 12/3/2018 2:20 PM, Hironobu Yamashita wrote:
Hi,
I'm suffering from reproducibility issue of pdf inclusion of LuaTeX. The output file size differs from time to time, and the largest one is more than twice of the smallest one! Please find the attached 20181203-luatex-pdfobj.tar.xz i can't reproduce it here (in hundreds of runs, including all pages, either or not using immediate flushing) ... however, maybe you can get weird results when you run in parallel i.e. your pdf file is not yet closed when the next process starts)
Hans ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl -----------------------------------------------------------------
participants (3)
-
Hans Hagen -
Hironobu Yamashita -
luigi scarso