On 25-11-2011 20:03, Christian wrote:

Same here. It messes up when converting .bib to .bbl. Maybe check your bbl file, too. Mine looks like this, for example: a={{Hirofumi Uzawa~宇沢弘文}}

You could try to write the .bbl file directly yourself, although that is not a comfortable option, if you have many Japanese entries. Apart from that there's not much coming to mind.

It makes me wonder how Thomas gets his greek etc done in bibtex. Hans ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com | www.pragma-pod.nl -----------------------------------------------------------------

Now that japanese display correctly, there is still another problem. Japanese sentences (long titles in bibliography) don't break at the end of line. I have tested the behavior of japanese with entire paragraphs, and I get the same problem as in the bibliography, lines don't break and go "through" the page. Though I have looked to documentation about chinese on the wiki, none helped me to solve this problem. Does someone have any idea ? Here is a minimal example with a paragraph sample in japanese : %%%%%%%%%beginning of file%%%%%%%%%% \usemodule[simplefonts] \setmainfont[HeiseiMinStd-W3] \definesimplefonttypeface[jpn][HeiseiMinStd-W3] \setupbodyfont[12pt] \setuptolerance[\v!verytolerant,\v!stretch] \enableregime[utf] \usemodule[typearea] \setupTypeArea[bcor=30mm,alphabets=2.6,oneside] %********************************* \starttext そしてディズニー原理主義で考えた場合、「一秒24コマの絵」で作るフルアニメが至上。そのルールに照らした場合、「電脳コイル」より「らき☆すた（ハルヒ）」の方が優れている。 ニョロニョロと滑らかに動く。つまりそれだけ動画枚数を多く使ってる。よりフルアニメに近い。よって「電脳コイル＜らき☆すた」となる。 コレに作画マニアは反論する。アニメは「アニメーターのスキル」こそが最も重要。「スキル＞作画枚数」、だから優れたアニメーターである磯光雄の手掛けた電脳コイルのほうが偉い。 じゃあ磯光雄がフルアニメにしたら？今の２コマ３コマ打ちの磯光雄より偉いの？より優れてるの？ ＞フルアニメの磯光雄の方が優れている。 この場合、「リミテッドアニメという制約の中で独自の進化をした日本アニメのアイデンティティ」というのが無くなってしまう。「らき☆すた」には勝てるがファンタジアには負ける。 ＞２、３コマ打ちのリミテッドの磯光雄の方が優れている。 質としては等価（磯光雄の原画）でより量のあるフルアニメよりもリミテッドアニメの方が優れてる、その理由を言語化する必要がある。 じゃあ、そのリミテッドで手に入れた価値とは何？ 例えば「フルアニメと同じ価値をリミテッド（より少ない動画枚数＝コスト）で作れるという『省エネ』の部分にある」ってこと？ソレだと新たな創作的価値を別に産み出してないよね。 そうでないのなら動きの質がディズニーとはどう違うの？ \stoptext %%%%%%%%%end of file%%%%%%%%%%%%% I attach the corresponding pdf file I obtain after compilation. 2011/11/25 Hans Hagen

On 25-11-2011 20:03, Christian wrote:

Same here. It messes up when converting .bib to .bbl. Maybe check your

...

bbl file, too. Mine looks like this, for example: a={{Hirofumi Uzawa~宇沢弘文}}

You could try to write the .bbl file directly yourself, although that is not a comfortable option, if you have many Japanese entries. Apart from that there's not much coming to mind.

It makes me wonder how Thomas gets his greek etc done in bibtex.

Hans

------------------------------**------------------------------**----- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com | www.pragma-pod.nl ------------------------------**------------------------------**-----

______________________________**______________________________** _______________________ If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/** listinfo/ntg-context http://www.ntg.nl/mailman/listinfo/ntg-context webpage : http://www.pragma-ade.nl / http://tex.aanhet.net archive : http://foundry.supelec.fr/**projects/contextrev/http://foundry.supelec.fr/projects/contextrev/ wiki : http://contextgarden.net ______________________________**______________________________** _______________________

-- ------------------------------------------------------------------------------ Alexandre KRISPIN 41 rue Guynemer | 93200 Saint-Denis | France tél : 06 28 76 69 34 | http://bijutsu.toile-libre.org ----------------------------------------------------------------------------

Thank you ! But with the scripts for chinese characters, I got the expected result :) Cheers, Alexandre Krispin 2011/11/27 Mojca Miklavec

2011/11/26 Alexandre Krispin wrote:

...

Now that japanese display correctly, there is still another problem. Japanese sentences (long titles in bibliography) don't break at the end of line. I have tested the behavior of japanese with entire paragraphs, and I get the same problem as in the bibliography, lines don't break and go "through" the page.

Though I have looked to documentation about chinese on the wiki, none helped me to solve this problem. Does someone have any idea ?

My first guess is that ConTeXt doesn't know how to "hyphenate" / split words or sentences without space. I don't know what the Japanese typesetting rules are, but if nothing is implemented yet, it cannot work.

Mojca

___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context webpage : http://www.pragma-ade.nl / http://tex.aanhet.net archive : http://foundry.supelec.fr/projects/contextrev/ wiki : http://contextgarden.net

___________________________________________________________________________________

-- ------------------------------------------------------------------------------ Alexandre KRISPIN 41 rue Guynemer | 93200 Saint-Denis | France tél : 06 28 76 69 34 | http://bijutsu.toile-libre.org ----------------------------------------------------------------------------

On 11/25/2011 09:09 PM, Hans Hagen wrote:

It makes me wonder how Thomas gets his greek etc done in bibtex.

To be quite honest: I rarely have more than a few words of Greek, and I wrap them up in \localgreek{} markup in my bibtex files, so I assume that's why I have never run into this problem. But it's another example to show that bibtex has huge problems outside of English (ASCII) range. It would be great if we could get rid of it ASAP... Thomas

On 7-12-2011 17:37, Alexandre Krispin wrote:

Thank you for your answer !

Finally I am back to Latex until this problem is fixed. Though I have no knowledge about it, it seemed to me that the problem I got was more related to hanzi script than to bibtex, since the final problem of misplaced dots I had appeared only with hanzi script.

Hans Hagen did not replied to it. That's why I suppose that one day if this problem related to hanzi script becomes a problem of general interest, maybe it will be fixed...

As mentioned on this list using a unicode (utf) engine with bibtex is somewhat tricky. Interesting is that a similar problem occurred with url's: bibtex has hard coded line lengths and if I'm right there has been a fix that made lines wrap on spaces. However that does not help with scripts that have no spaces. Somewhat strange is that bibtex was not made compliant to other tex related programs in the sense that one can configure the line length (which we would then set to 1000 or so). In spite of repeated announcements of bibtex 1.0 (which would probably not fix this issue anyway) it looks like the program is deep frozen. Unfortunately it also has frozen some conventions that make it hard to replace it. Fixing it is probably something that an able programmer can do while watching a movie at the same time were it not that touching bibtex seems to be some kind of sacrilege. I can imagine that someone makes a copy of bibtex, say ctxbibtex, patches it to accept long lines and that we ship that one with context. Hans ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com | www.pragma-pod.nl -----------------------------------------------------------------

Thanks Ulrike ! It seems the 2 messages I sent yesterday have been lost (I have received a mail which might point out a delivery failure from the mailing list) though it is written I don't need to send again the message, in case, here is the copy of mails I sent. Now the only problem remaining is that japanese sentences are not wrapped (long titles of books go through the page). And though I took a look to documentation about chinese, I don't know what I am missing. *******************************************Beginning of first mail******************************************************** Hello, Thanks to all for your answers ! Finally, thanks to an article dealing about Xelatex, bibtex files and utf-8 problem (see http://skalldan.wordpress.com/2011/08/01/%E3%82%A4%E3%83%B3%E3%83%89%E5%AD%A...) I got the idea how to solve my problem. In the bib file I have surrounded all japanese words by {\jpn }, like in this minimal example : %%%%%%%%%beginning of the example%%%%%%%%%%% @article{uzawa2011tpp, author = "Hirofumi Uzawa {\jpn 宇沢弘文}, Uchihashi Katsuto {\jpn 内橋克人}", journal = "Sekai {\jpn 世界}", title = "Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru {\jpn 対談TPPは社会的共通資本を破壊する}", year = 2011, month = "april", publisher = "Iwanami shoten {\jpn 岩波書店}", pages = "62-72", url = "http://ci.nii.ac.jp/naid/40018706510/", note = "test" } %%%%%%%%%%%%end of file%%%%%%%%%%%%%% Then, thanks to the documentation for simplefonts I have introduced a typeface definition, like in this minimal example : %%%%%%%%%%beginning of file%%%%%%%%%%%%% \usemodule[simplefonts] \setmainfont[Arno Pro] \definesimplefonttypeface[jpn] [hiraginokakugothicpro] \enableregime[utf8] \setupbibtex[database=biblio] \starttext test \completepublications[criterium=all] {\jpn 知らない 金 11月 25, 2011 10:21午後} \stoptext %%%%%%%%%%end of file%%%%%%%%%%%%%%% And everything works well when compiling the whole with "context *tex". The only question remaining in my mind is : is there another way ? Just out of curiosity, since Hans Hagen mentioned "Thomas" who use greek. *******************************************End of first mail******************************************************** And the second mail : *******************************************Beginning of second mail******************************************************** Now that japanese display correctly, there is still another problem. Japanese sentences (long titles in bibliography) don't break at the end of line. I have tested the behavior of japanese with entire paragraphs, and I get the same problem as in the bibliography, lines don't break and go "through" the page. Though I have looked to documentation about chinese on the wiki, none helped me to solve this problem. Does someone have any idea ? Here is a minimal example with a paragraph sample in japanese : %%%%%%%%%beginning of file%%%%%%%%%% \usemodule[simplefonts] \setmainfont[HeiseiMinStd-W3] \definesimplefonttypeface[jpn] [HeiseiMinStd-W3] \setupbodyfont[12pt] \setuptolerance[\v!verytolerant,\v!stretch] \enableregime[utf] \usemodule[typearea] \setupTypeArea[bcor=30mm,alphabets=2.6,oneside] %********************************* \starttext そしてディズニー原理主義で考えた場合、「一秒24コマの絵」で作るフルアニメが至上。そのルールに照らした場合、「電脳コイル」より「らき☆すた（ハルヒ）」の方が優れている。 ニョロニョロと滑らかに動く。つまりそれだけ動画枚数を多く使ってる。よりフルアニメに近い。よって「電脳コイル＜らき☆すた」となる。 コレに作画マニアは反論する。アニメは「アニメーターのスキル」こそが最も重要。「スキル＞作画枚数」、だから優れたアニメーターである磯光雄の手掛けた電脳コイルのほうが偉い。 じゃあ磯光雄がフルアニメにしたら？今の２コマ３コマ打ちの磯光雄より偉いの？より優れてるの？ ＞フルアニメの磯光雄の方が優れている。 この場合、「リミテッドアニメという制約の中で独自の進化をした日本アニメのアイデンティティ」というのが無くなってしまう。「らき☆すた」には勝てるがファンタジアには負ける。 ＞２、３コマ打ちのリミテッドの磯光雄の方が優れている。 質としては等価（磯光雄の原画）でより量のあるフルアニメよりもリミテッドアニメの方が優れてる、その理由を言語化する必要がある。 じゃあ、そのリミテッドで手に入れた価値とは何？ 例えば「フルアニメと同じ価値をリミテッド（より少ない動画枚数＝コスト）で作れるという『省エネ』の部分にある」ってこと？ソレだと新たな創作的価値を別に産み出してないよね。 そうでないのなら動きの質がディズニーとはどう違うの？ \stoptext %%%%%%%%%end of file%%%%%%%%%%%%% I attach the corresponding pdf file I obtain after compilation. *******************************************End of second mail******************************************************** 2011/11/26 Ulrike Fischer

Am Fri, 25 Nov 2011 19:50:52 +0100 schrieb Alexandre Krispin:

...

Hello,

I am trying to get japanese displayed in bibliography. But I get the error "! String contains an invalid utf-8 sequence." while compiling with the command "context *tex".

...

And here is the bib file :

%%%%%%%%%%%%%%%beginning of file%%%%%%% @article{uzawa2011tpp, author = "Hirofumi Uzawa 宇沢弘文, Uchihashi Katsuto 内橋克人", journal = "Sekai 世界", title = "Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru 対談TPPは社会的共通資本を破壊する", year = 2011, month = "april", publisher = "Iwanami shoten 岩波書店", pages = "62-72", url = "http://ci.nii.ac.jp/naid/40018706510/", } %%%%%%%%%%%%%%%end of file%%%%%%%%%%

Do someone know how to get ride of utf-8 errors ? Or is this a problem with bibtex,

Yes. bibtex is an 8-bit application. Your japanese characters consist of three or four 8-bit-blocks. As bibtex has no knowledge that these blocks should be keeped together it can happen that bibtex breaks them in pieces e.g. at line ends and so you end with invalid utf8. You could try to move the blocks a bit around e.g. with braces or spaces so that bibtex finds a break point between the utf8-chars and not in the middle of one of them.

...

and then should I use anything else to replace it ? (does something like Biber work ?)

Well in latex with biblatex it works and is the recommended solution. But I don't know if context supports biber.

-- Ulrike Fischer

___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context webpage : http://www.pragma-ade.nl / http://tex.aanhet.net archive : http://foundry.supelec.fr/projects/contextrev/ wiki : http://contextgarden.net

___________________________________________________________________________________

-- ------------------------------------------------------------------------------ Alexandre KRISPIN 41 rue Guynemer | 93200 Saint-Denis | France tél : 06 28 76 69 34 | http://bijutsu.toile-libre.org ----------------------------------------------------------------------------

Thanks ! It worked perfectly ! Cheers, Alexandre Krispin 2011/11/26 Wolfgang Schuster

Am 26.11.2011 um 11:44 schrieb Alexandre Krispin:

...

Now that japanese display correctly, there is still another problem. Japanese sentences (long titles in bibliography) don't break at the end of line. I have tested the behavior of japanese with entire paragraphs, and I get the same problem as in the bibliography, lines don't break and go "through" the page.

Though I have looked to documentation about chinese on the wiki, none helped me to solve this problem. Does someone have any idea ?

Add “\setscript[hanzi]” to your document.

Wolfgang

___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context webpage : http://www.pragma-ade.nl / http://tex.aanhet.net archive : http://foundry.supelec.fr/projects/contextrev/ wiki : http://contextgarden.net

___________________________________________________________________________________

-- ------------------------------------------------------------------------------ Alexandre KRISPIN 41 rue Guynemer | 93200 Saint-Denis | France tél : 06 28 76 69 34 | http://bijutsu.toile-libre.org ----------------------------------------------------------------------------