docbuild: Japanese characters creeping into other parts of Sage documentation

[jhpalmieri]

Japanese characters creep into various parts of Sage documentation. For example, the table of contents in the (English) Sage developer's guide (html) has headings in Japanese, and when building the PDF version of it/a_tour_of_sage, I see this error:

    ! Package inputenc Error: Unicode character リ (U+30EA)

Indeed, the file local/share/doc/sage/latex/it/a_tour_of_sage/a_tour_of_sage.tex has the line

    \renewcommand{\releasename}{リリース}

and also a few lines earlier

    \date{2021年06月08日}

and at the bottom

    \renewcommand{\indexname}{索引}

These lines are the same as in ja/a_tour_of_sage/a_tour_of_sage.tex.

Depends on #31948

CC: @zlscherr @kiwifb @kliem @mkoeppe

Component: documentation

Issue created by migration from https://trac.sagemath.org/ticket/31936

[slel]

comment:2

Since maybe Sage 9.3, some interface elements of
the (English language) (html) developer guide appear
in Japanese for me in Sage built from source.

Comparing the online version and my local version
of the "Git setup" page for instance:

• https://doc.sagemath.org/html/en/developer/git_setup.html
• file:///path_to_sage/local/share/doc/sage/html/en/developer/git_setup.html

the correspondence is as follows.

Menu headers in the left menu:

• Table of Contents - 目次
• Previous topic - 前のトピックへ
• Next topic - 次のトピックへ
• This Page - このページ
• Quick search - クイック検索

Navigation menu (top right and bottom right):

• previous - 前へ
• next - 次へ
• index - 索引

[jhpalmieri]

comment:3

Oh, I see that too. Ticket summary changed.

[jhpalmieri]

comment:4

The Sphinx upgrade #31696 doesn't help.

[dimpase]

comment:5

I cannot reproduce this on (Gentoo) Linux. Everything looks fine.
On the other hand, I see it (Japanese menus) on macOS 11.4, too.

[dimpase]

comment:6

#30551 changed various locale settings, perhaps it's the culprit.

[jhpalmieri]

comment:7

The problem is #31344, in particular commit b4ceee5.

[kiwifb]

comment:9

Do we have some kind of race condition between languages? Does the problem persists when building serially?

[jhpalmieri]

comment:10

If I unset MAKE, I think that makes it build serially, and I still see the problem. I wonder if it comes from lines like this in src/doc/ja/a_tour_of_sage/conf.py:

from sage.docs.conf import release, latex_elements
from sage.docs.conf import *  # NOQA

and similar lines in other conf.py files. Could modifications to configuration variables get passed between different builds?

[mkoeppe]

comment:11

Replying to @jhpalmieri:

The problem is #31344, in particular commit b4ceee5.

Nice catch. Previously the different languages were isolated in separate processes via build_many, now they run serially in the same Python process, so there's a potential for state to persist.

[mkoeppe]

comment:12

#31948 (Reimplement parallel docbuild using make) could be a solution; or a simpler workaround using os.system (or similar) to run the separate documents serially in separate processes.

[mkoeppe]

Dependencies: #31948

[jhpalmieri]

comment:14

I think that #31948 fixes this. Once that's merged and tested, we should close this ticket.