tox.ini: Various CI fixes

[mkoeppe]

• Add a homebrew environment local-homebrew-macos-usrlocal that uses the global homebrew in /usr/local. This will be faster and may be more robust for GitHub Actions builds because "bottles" of more packages can be used. (For a while, for example, all homebrew-standard builds fail because the homebrew ppl package cannot be installed from source - "brew install -s ppl" fails - 401 Unauthorized Homebrew/homebrew-core#57499)

• Disable testsuites that need pip (ssl)

This is on top of:

• Also, add "make dist" testing to tox.ini (prompted by breakage in Clean-up for src/bin/sage-env, move src/bin/sage-clone-source, src/bin/sage-sdist to build/bin #29825). This is Fix "make dist", add test run to GitHub Actions #30088

• Add a macos environment without homebrew, conda: That's a configuration that was causing trouble in Move Extension options from src/module_list.py to "distutils:" directives in the individual files (part 1 - some packages without OptionalExtensions) #29706 and is so far not tested in the GitHub CI tests. This is added by Fix "make dist", add test run to GitHub Actions #30088 too (make dist)

Depends on #29851
Depends on #29105
Depends on #30064
Depends on #30048
Depends on #30088
Depends on #30118

Upstream: Reported upstream. No feedback yet.

CC: @kliem

Component: porting

Author: Matthias Koeppe

Branch/Commit: b62f775

Reviewer: Jonathan Kliem

Issue created by migration from https://trac.sagemath.org/ticket/29929

[jhpalmieri]

comment:1

I'll repeat a comment I made at #29706: I really needed an environment without homebrew to replicate the failures; just having a minimal homebrew installation, or having one with temporarily moved pkgconfig directories, wasn't enough to get the failures.

(So I'm emphasizing that I'm agreeing with the summary: "without homebrew".)

[mkoeppe]

Upstream: Reported upstream. No feedback yet.

[mkoeppe]

Dependencies: #29851, #29105

[mkoeppe]

Changed dependencies from #29851, #29105 to #29851, #29105, #30064

[mkoeppe]

Branch: u/mkoeppe/tox_ini__add_a_macos_environment_without_homebrew__conda

[mkoeppe]

Commit: bfb2fb4

[mkoeppe]

New commits:

539c182	build/make/install: Do not depend on src/bin/sage-version.sh
761092c	Merge branch 't/29987/build_make_install__do_not_depend_on_src_bin_sage_version_sh' into t/30064/fix_tox_docker_builds_broken_by__29884
f2efa6a	src/doc/bootstrap: Create the directory src/doc/en/reference/repl if it does not exist
b7bf43b	build/bin/write-dockerfile.sh: ADD src/bin for bootstrapping, needed by src/doc/bootstrap after #29884
365ce61	Merge branch 'u/mkoeppe/fix_tox_docker_builds_broken_by__29884' of git://trac.sagemath.org/sage into HEAD
1e7becc	tox.ini [debian-buster, -sid]: IGNORE_MISSING_SYSTEM_PACKAGES=yes because of libpython3.7-dev
fb61a31	Merge branch 'u/mkoeppe/tox_ini__debian_bullseye___sid_have_python3_8_instead_of_3_7' of git://trac.sagemath.org/sage into 9.2.beta3+ci-fixes
bfb2fb4	tox.ini: Add environment local-homebrew-usrlocal

[mkoeppe]

Changed dependencies from #29851, #29105, #30064 to #29851, #29105, #30064, #30088

[mkoeppe]

Changed dependencies from #29851, #29105, #30064, #30088 to #29851, #29105, #30064, #30048, #30088

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

aded967	Merge commit '8195cb821e01e0cb627240d7135d5634c265cab0' of git://trac.sagemath.org/sage into t/29929/tox_ini__add_a_macos_environment_without_homebrew__conda
07d657d	Merge tag '9.2.beta4' into t/29929/tox_ini__add_a_macos_environment_without_homebrew__conda

[sagetrac-git]

Changed commit from bfb2fb4 to 07d657d

[sagetrac-git]

Changed commit from 07d657d to bd15fb9

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

bd15fb9

build/bin/write-dockerfile.sh, tox.ini: Do not run testsuites that need pip (ssl)

[mkoeppe]

Changed dependencies from #29851, #29105, #30064, #30048, #30088 to #29851, #29105, #30064, #30048, #30088, #30118

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

25393b0	Handle SAGE_CHECK_PACKAGES in build/make/Makefile.in, not sage-spkg
5aca238	Merge branch 't/30118/handle_sage_check_packages_in_build_make_makefile_in__not_sage_spkg' into t/29929/tox_ini__add_a_macos_environment_without_homebrew__conda

[sagetrac-git]

Changed commit from bd15fb9 to 5aca238

[sagetrac-git]

Changed commit from 5aca238 to d1a2cbf

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

a17c655	m4/sage_spkg_collect.m4: Do not include script packages in SAGE_SDIST_PACKAGES
827923a	bootstrap: Accept 2020s in config.guess version check
c30ac54	tox.ini: Add local-nobootstrap
de6464d	.github/workflows/tox.yml: Add jobs "dist", "local-macos-nohomebrew
775b7f7	Trac #30088: add a few explanatory comments to m4/sage_spkg_collect.m4.
160862f	m4/sage_spkg_collect.m4: Mention sagelib in the comment
d1a2cbf	Merge branch 't/30088/fix__make_sdist___add_test_run_to_github_actions' into t/29929/tox_ini__add_a_macos_environment_without_homebrew__conda

[dimpase]

comment:21

is this still "new"?

[mkoeppe]

Author: Matthias Koeppe

[mkoeppe]

comment:23

The cygwin CI wishlist has been moved to #30154.

Needs review

[kliem]

Reviewer: Jonathan Kliem

[kliem]

comment:24

Looks reasonable.

Can you provide an example of this ticket in action (you probably have been using it already anyway?).

What's symengine_py?

[mkoeppe]

comment:25

Replying to @kliem:

What's symengine_py?

See #29497

[mkoeppe]

comment:26

Replying to @kliem:

Can you provide an example of this ticket in action (you probably have been using it already anyway?).

The SAGE_CHECK_PACKAGES adjustments are used in #29766.

[kliem]

comment:27

LGTM.

[mkoeppe]

comment:28

Thanks!

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1 and set ticket back to needs_review. New commits:

b62f775

Merge tag '9.2.beta6' into t/29929/tox_ini__add_a_macos_environment_without_homebrew__conda

[sagetrac-git]

Changed commit from d1a2cbf to b62f775

[vbraun]

Changed branch from u/mkoeppe/tox_ini__add_a_macos_environment_without_homebrew__conda to b62f775