[BUG]: Compilation failure with GCC 10.2 on pybind11 2.13.0 (typing.h, line 209) #5201

zhqrbitee · 2024-06-26T18:12:32Z

Required prerequisites

Make sure you've read the documentation. Your issue may be addressed there.
Search the issue tracker and Discussions to verify that this hasn't already been reported. +1 or comment there if it has.
Consider asking first in the Gitter chat room or in a Discussion.

What version (or hash if on master) of pybind11 are you using?

2.13.0

Problem description

Environment:

Compiler: GCC 10.2
C++ Language Dialect: C++20 (std=c++20)

Error Message:

In file included from my_venv/include/pybind11/pybind11.h:19,
                 from my_venv/include/pybind11/numpy.h:12
my_venv/include/pybind11/typing.h:219:49: error: class template argument deduction failed:
  219 | struct handle_type_name<typing::Literal<Literals...>> {
      |                                                 ^~~
compilation terminated due to -Wfatal-errors.

It seems the error just comes from including pybind11 headers and it comes after upgrading to 2.13.

#if defined(__cpp_nontype_template_parameter_class)
template <typing::StringLiteral... Literals>
struct handle_type_name<typing::Literal<Literals...>> {
    static constexpr auto name = const_name("Literal[")
                                 + pybind11::detail::concat(const_name(Literals.name)...)
                                 + const_name("]");
};
template <typing::StringLiteral StrLit>
struct handle_type_name<typing::TypeVar<StrLit>> {
    static constexpr auto name = const_name(StrLit.name);
};
#endif

I see it tries to use the macro __cpp_nontype_template_parameter_class to enable some template codes. However not sure why the macro check is success, but GCC 10.2 fails to compile the codes.

Reproducible example code

No response

Is this a regression? Put the last known working version here if it is.

2.12.0

The text was updated successfully, but these errors were encountered:

henryiii · 2024-06-27T03:30:49Z

class template argument deduction failed

I assume it's trying to deduce something which means it's failing on a usage of it (and we test on GCC 10.2.1), so it's probably a regression for some usage. Do you know where this template is being used in your code?

zhqrbitee · 2024-06-27T05:51:02Z

Hi @henryiii ,

Thanks for your reply.
This is something looks very weird to me. Based on my observation, as long as I include the pybind11/pybind11.h, it produces above compile failure.

I can reproduce using the simple example from the docs:

#include "pybind11/pybind11.h"

int add(int i, int j) {
    return i + j;
}

PYBIND11_MODULE(example, m) {
    m.doc() = "pybind11 example plugin"; // optional module docstring

    m.def("add", &add, "A function that adds two numbers");
}

and compile with the command:

// $CXX point our GCC 10.2 bin
$CXX -O3 -Wall -shared -std=c++20 -fPIC $(python3 -m pybind11 --includes) example.cpp -o example.cpython-39m-x86_64-linux-gnu.so

It gives a bit more message this case (maybe because I didn't use -Wfatal-errors), but I still get no clue:

In file included from my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/pybind11.h:19,
                 from example.cpp:1:
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:219:49: error: class template argument deduction failed:
  219 | struct handle_type_name<typing::Literal<Literals...>> {
      |                                                 ^~~
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:219:49: error: no matching function for call to 'StringLiteral(StringLiteral<...auto...>)'
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:104:15: note: candidate: 'template<long unsigned int N> StringLiteral(const char (&)[N])-> pybind11::typing::StringLiteral<N>'
  104 |     constexpr StringLiteral(const char (&str)[N]) { std::copy_n(str, N, name); }
      |               ^~~~~~~~~~~~~
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:104:15: note:   template argument deduction/substitution failed:
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:219:49: note:   mismatched types 'const char [N]' and 'StringLiteral<...auto...>'
  219 | struct handle_type_name<typing::Literal<Literals...>> {
      |                                                 ^~~
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:103:8: note: candidate: 'template<long unsigned int N> StringLiteral(pybind11::typing::StringLiteral<N>)-> pybind11::typing::StringLiteral<N>'
  103 | struct StringLiteral {
      |        ^~~~~~~~~~~~~
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:103:8: note:   template argument deduction/substitution failed:
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:219:49: note:   mismatched types 'pybind11::typing::StringLiteral<N>' and 'StringLiteral<...auto...>'
  219 | struct handle_type_name<typing::Literal<Literals...>> {
      |                                                 ^~~
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:219:52: error: template argument 1 is invalid
  219 | struct handle_type_name<typing::Literal<Literals...>> {
      |                                                    ^~
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:225:41: error: class template argument deduction failed:
  225 | struct handle_type_name<typing::TypeVar<StrLit>> {
      |                                         ^~~~~~
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:225:41: error: no matching function for call to 'StringLiteral(StringLiteral<...auto...>)'
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:104:15: note: candidate: 'template<long unsigned int N> StringLiteral(const char (&)[N])-> pybind11::typing::StringLiteral<N>'
  104 |     constexpr StringLiteral(const char (&str)[N]) { std::copy_n(str, N, name); }
      |               ^~~~~~~~~~~~~
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:104:15: note:   template argument deduction/substitution failed:
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:225:41: note:   mismatched types 'const char [N]' and 'StringLiteral<...auto...>'
  225 | struct handle_type_name<typing::TypeVar<StrLit>> {
      |                                         ^~~~~~
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:103:8: note: candidate: 'template<long unsigned int N> StringLiteral(pybind11::typing::StringLiteral<N>)-> pybind11::typing::StringLiteral<N>'
  103 | struct StringLiteral {
      |        ^~~~~~~~~~~~~
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:103:8: note:   template argument deduction/substitution failed:
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:225:41: note:   mismatched types 'pybind11::typing::StringLiteral<N>' and 'StringLiteral<...auto...>'
  225 | struct handle_type_name<typing::TypeVar<StrLit>> {
      |                                         ^~~~~~
my__venv/lib/python3.9/site-packages/pybind11/include/pybind11/typing.h:225:47: error: template argument 1 is invalid
  225 | struct handle_type_name<typing::TypeVar<StrLit>> {
      |                                               ^~

BTW, we have another CI that run in macOS with Apple-clang and that seems OK to compile.

zhqrbitee · 2024-06-27T05:59:44Z

After a few more tries. the error seems only happen when I enable -std=c++20 (this is the standard we use in our environment), if I low down it to -std=c++17, it can be compiled successful, e.g.

// $CXX point our GCC 10.2 bin
$CXX -O3 -Wall -shared -std=c++17 -fPIC $(python3 -m pybind11 --includes) example.cpp -o example.cpython-39m-x86_64-linux-gnu.so

henryiii · 2024-06-27T06:38:38Z

We might be missing a c++20 test on this compiler.

rwgk · 2024-06-27T06:55:35Z

It seems very likely to me that you're stumbling over a bug in that old GCC release. We're testing with C++20 using a variety of more modern C++ compilers (clang, gcc, msvc).

A simple, pragmatic workaround would be to add to the ifdef here:

pybind11/include/pybind11/typing.h

Line 225 in 57287b5

#if defined(__cpp_nontype_template_parameter_class)

... && !defined(...conditions for GCC 10...)

~~But that wouldn't be covered by our GitHub Actions, which brings me to the question:~~

~~What platform do you have, and how exactly did you get your GCC 10? (Could we reproduce that with a GHA job, with a reasonable effort?)~~

@InvincibleRMC for awareness (and ideas).

rwgk · 2024-06-27T07:03:40Z

Oops, sorry, I just realized I mixed up clang 10 vs gcc 10 in my mind: we actually do have gcc 10 testing, e.g. here:

https://github.com/pybind/pybind11/actions/runs/9687720852/job/26732870800

It should be super easy to add gcc 10 C++20 testing along with the ifdef workaround. (Unless we're stumbling over other (presumed) bugs in the compiler.)

zhqrbitee · 2024-06-27T08:13:29Z

Hi @rwgk @henryiii ,

Thanks very much for your quick response. I forked a repo on my side and tried different version of gcc: https://github.com/zhqrbitee/pybind11/actions/runs/9692860216/job/26747094324.

I short, GCC 9, GCC 10.1, 10.2 have this issue with c++20. GCC 10.3 (and above) seems to have fixed it.

InvincibleRMC · 2024-06-27T21:08:21Z

@rwgk Do you want me to implement the suggest changes or are you on it?

rwgk · 2024-06-27T21:23:32Z

@rwgk Do you want me to implement the suggest changes or are you on it?

It'd be helpful if you could send the PR. Thanks!

see: pybind/pybind11#5201

This is to make `zxing-cpp` build again. The root cause is an issue in `pybind11`, see: * https://github.com/pybind/pybind11/releases/tag/v2.13.1 * pybind/pybind11#5201 * pybind/pybind11#5205 * zxing-cpp/zxing-cpp#803

see: pybind/pybind11#5201

zhqrbitee added the triage New bug, unverified label Jun 26, 2024

zhqrbitee changed the title ~~[BUG]: Compiling failure with GCC 10.2 on pybind11 2.13.0 (typing.h, line 209)~~ [BUG]: Compilation failure with GCC 10.2 on pybind11 2.13.0 (typing.h, line 209) Jun 26, 2024

InvincibleRMC mentioned this issue Jun 27, 2024

fix: add guard for GCC <10.3 on C++20 #5205

Merged

rwgk closed this as completed in #5205 Jun 28, 2024

Mizux mentioned this issue Jul 2, 2024

[BUG]: Typing.h not working with gcc-14 (line 104) #5206

Closed

3 tasks

Mizux added a commit to Mizux/bazel-pybind11-abseil that referenced this issue Jul 2, 2024

bazel: target c++17 to avoid pybind11 compilation issue

2a39d81

see: pybind/pybind11#5201

axxel mentioned this issue Jul 3, 2024

pip3 installation of zxing-cpp 2.2.0 fails in NVDIA Jetson zxing-cpp/zxing-cpp#803

Closed

EchterAgo mentioned this issue Jul 6, 2024

build: switch AppImage to gcc 10 and remove mksquashfs build Electron-Cash/Electron-Cash#2885

Merged

Mizux added a commit to Mizux/bazel-pybind11-abseil that referenced this issue Jul 11, 2024

bazel: target c++17 to avoid pybind11 compilation issue

933620d

see: pybind/pybind11#5201

ObeliskGate mentioned this issue Aug 23, 2024

fix: using __cpp_nontype_template_args instead of __cpp_nontype_template_parameter_class #5330

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[BUG]: Compilation failure with GCC 10.2 on pybind11 2.13.0 (typing.h, line 209) #5201

[BUG]: Compilation failure with GCC 10.2 on pybind11 2.13.0 (typing.h, line 209) #5201

zhqrbitee commented Jun 26, 2024 •

edited

Loading

henryiii commented Jun 27, 2024

zhqrbitee commented Jun 27, 2024 •

edited

Loading

zhqrbitee commented Jun 27, 2024 •

edited

Loading

henryiii commented Jun 27, 2024

rwgk commented Jun 27, 2024 •

edited

Loading

rwgk commented Jun 27, 2024

zhqrbitee commented Jun 27, 2024 •

edited

Loading

InvincibleRMC commented Jun 27, 2024

rwgk commented Jun 27, 2024

[BUG]: Compilation failure with GCC 10.2 on pybind11 2.13.0 (typing.h, line 209) #5201

[BUG]: Compilation failure with GCC 10.2 on pybind11 2.13.0 (typing.h, line 209) #5201

Comments

zhqrbitee commented Jun 26, 2024 • edited Loading

Required prerequisites

What version (or hash if on master) of pybind11 are you using?

Problem description

Environment:

Error Message:

Reproducible example code

Is this a regression? Put the last known working version here if it is.

henryiii commented Jun 27, 2024

zhqrbitee commented Jun 27, 2024 • edited Loading

zhqrbitee commented Jun 27, 2024 • edited Loading

henryiii commented Jun 27, 2024

rwgk commented Jun 27, 2024 • edited Loading

rwgk commented Jun 27, 2024

zhqrbitee commented Jun 27, 2024 • edited Loading

InvincibleRMC commented Jun 27, 2024

rwgk commented Jun 27, 2024

zhqrbitee commented Jun 26, 2024 •

edited

Loading

zhqrbitee commented Jun 27, 2024 •

edited

Loading

zhqrbitee commented Jun 27, 2024 •

edited

Loading

rwgk commented Jun 27, 2024 •

edited

Loading

zhqrbitee commented Jun 27, 2024 •

edited

Loading