gh-110152: regrtest handles cross compilation and HOSTRUNNER

[vstinner]

• _add_python_opts() now handles cross compilation and HOSTRUNNER.
• display_header() now tells if Python is cross-compiled, display HOSTRUNNER, and get the host platform.
• Remove Tools/scripts/run_tests.py script.
• Remove "make hostrunnertest": use "make buildbottest" or "make test" instead.

• Issue: regrtest: handle cross compilation and HOSTRUNNER in libregrtest, avoid Tools/scripts/run_tests.py #110152

[vstinner]

!buildbot wasm

[bedevere-bot]

🤖 New build scheduled with the buildbot fleet by @vstinner for commit cd4bf78 🤖

The command will test the builders whose names match following regular expression: wasm

The builders matched are:

• wasm32-emscripten browser (dynamic linking, no tests) PR
• wasm32-wasi PR
• wasm32-emscripten node (pthreads) PR
• wasm32-emscripten node (dynamic linking) PR

[vstinner]

wasm32-emscripten node (pthreads) PR:

make buildbottest 'TESTOPTS=-j2  --junit-xml test-results.xml -j2 ${BUILDBOT_TESTOPTS}' TESTPYTHONOPTS= TESTTIMEOUT=1200
(...)
_PYTHON_HOSTRUNNER='/opt/emsdk/node/current/bin/node --experimental-wasm-bigint --experimental-wasm-threads --experimental-wasm-bulk-memory' _PYTHON_PROJECT_BASE=/opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-pthreads/build/build_oot/host _PYTHON_HOST_PLATFORM=emscripten-wasm32 PYTHONPATH=/opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-pthreads/build/build_oot/host/build/lib.emscripten-wasm32-3.13:../../Lib _PYTHON_SYSCONFIGDATA_NAME=_sysconfigdata__emscripten_wasm32-emscripten ../build/python  -m test --slow-ci --timeout=1200 -j2  --junit-xml test-results.xml -j2 
+ ../build/python -u -W default -bb -m test --slow-ci --timeout=1200 -j2 --junit-xml test-results.xml -j2 --python '/opt/emsdk/node/current/bin/node --experimental-wasm-bigint --experimental-wasm-threads --experimental-wasm-bulk-memory python.js' --dont-add-python-opts
== CPython 3.13.0a0 (heads/refs/pull/110156/merge-dirty:752dc07d2d, Sep 30 2023, 20:25:56) [GCC 9.4.0]
== Linux-5.15.0-1019-azure-x86_64-with-glibc2.31 little-endian
== Python build: release
== cwd: /opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-pthreads/build/build_oot/host/build/test_python_worker_1799820æ
== CPU count: 8
== encodings: locale=UTF-8, FS=utf-8
== resources (10): audio, cpu, curses, decimal, gui, largefile, network, subprocess, urlfetch, walltime
== cross compiled: Yes
== host python: /opt/emsdk/node/current/bin/node --experimental-wasm-bigint --experimental-wasm-threads --experimental-wasm-bulk-memory python.js
== host platform: Emscripten-3.1.22-wasm32-32bit

wasm32-emscripten node (dynamic linking) PR:

make buildbottest 'TESTOPTS=-j2  --junit-xml test-results.xml -j2 ${BUILDBOT_TESTOPTS}' TESTPYTHONOPTS= TESTTIMEOUT=1200
(...)
_PYTHON_HOSTRUNNER='/opt/emsdk/node/current/bin/node --experimental-wasm-bigint' _PYTHON_PROJECT_BASE=/opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-dl/build/build_oot/host _PYTHON_HOST_PLATFORM=emscripten-wasm32 PYTHONPATH=/opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-dl/build/build_oot/host/build/lib.emscripten-wasm32-3.13:../../Lib _PYTHON_SYSCONFIGDATA_NAME=_sysconfigdata__emscripten_wasm32-emscripten ../build/python  -m test --slow-ci --timeout=1200 -j2  --junit-xml test-results.xml -j2 
+ ../build/python -u -W default -bb -m test --slow-ci --timeout=1200 -j2 --junit-xml test-results.xml -j2 --python '/opt/emsdk/node/current/bin/node --experimental-wasm-bigint python.js' --dont-add-python-opts
== CPython 3.13.0a0 (heads/refs/pull/110156/merge-dirty:752dc07d2d, Sep 30 2023, 20:22:43) [GCC 9.4.0]
== Linux-5.15.0-1019-azure-x86_64-with-glibc2.31 little-endian
== Python build: release
== cwd: /opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-dl/build/build_oot/host/build/test_python_worker_1786909æ
== CPU count: 8
== encodings: locale=UTF-8, FS=utf-8
== resources (10): audio, cpu, curses, decimal, gui, largefile, network, subprocess, urlfetch, walltime
== cross compiled: Yes
== host python: /opt/emsdk/node/current/bin/node --experimental-wasm-bigint python.js
== host platform: Emscripten-3.1.22-wasm32-32bit

[vstinner]

Oh, wasm32-wasi PR failed on test.pythoninfo:

Checked 106 modules (74 built-in, 0 shared, 19 n/a on wasi-wasm32, 1 disabled, 12 missing, 0 failed on import)
wasmtime run --env PYTHONPATH=/build_oot/host/build/lib.wasi-wasm32-3.13:/Lib --mapdir /::../.. -- ./python.wasm -m test.pythoninfo
Fatal Python error: _Py_HashRandomization_Init: failed to get random numbers to initialize Python
Python runtime state: preinitialized
make: *** [Makefile:1990: pythoninfo] Error 1

[vstinner]

Oh, wasm32-wasi PR failed on test.pythoninfo

Fixed by PR gh-110161.