Fix ODR issue in type_caster which could result in UB when -flto is enabled
#1514
| Job | Run time |
|---|---|
| 1m 10s | |
| 1m 10s |
-flto is enabled
#1514
| Job | Run time |
|---|---|
| 1m 10s | |
| 1m 10s |