Clean and harmonize module_list.py

[kiwifb]

module_list.py is quite messy in its current state. There are several things that can be done:

1. remove the unused debian bits
2. we have SAGE_LOCAL and SAGE_INC variables but there use iis not uniform
3. we also have numpy_include_dirs, numpy_depends, flint_depends, singular_depends and ginac_depends and most of them are under-used.

In this ticket I remove old debian stuff, use SAGE_INC, SAGE_LOCAL and the other variables in a uniform fashion removing all instances of SAGE_ROOT +/local/... and so on to replace it by the appropriate variable.

Apply:

• attachment: trac_11377-build_module_listpy.patch
• attachment: trac_11377-extraflint-dependencies.patch

CC: @strogdon @robertwb

Component: build

Keywords: sd31

Author: François Bissey

Reviewer: Volker Braun

Merged: sage-4.7.1.alpha4

Issue created by migration from https://trac.sagemath.org/ticket/11377

[kiwifb]

Attachment: trac_11377-build_module_listpy.patch.gz

patch to module_list.py

[kiwifb]

Author: François Bissey

[kiwifb]

comment:3

Now that 4.7.1.alpha0 is out this can be reviewed.

[vbraun]

comment:4

Looks good to me. But in Sage-4.7.1.alpha2 there were some more extension modules added (under sage.groups.perm_gps.partn_ref). Can you updated your patch for that? I'll review it then asap.

[vbraun]

Changed keywords from none to sd31

[kiwifb]

comment:6

It is up to date for 4.7.1.alpha2 already. The only possible problems could be with #9989 depending on which one is merged first and whether my suggested changes for it are accepted.

[vbraun]

comment:7

The patch applies, but sage.groups.perm_gps.partn_ref.* don't use SAGE_INC and the flint_depends:

    Extension('sage.groups.perm_gps.partn_ref.automorphism_group_canonical_label',
              sources = ['sage/groups/perm_gps/partn_ref/automorphism_group_canonical_label.pyx'],
              libraries = ['gmp', 'flint'],
              include_dirs = [SAGE_ROOT + '/local/include/FLINT/'],
              extra_compile_args = ['-std=c99'],
              depends = [SAGE_ROOT + "/local/include/FLINT/flint.h"]),

[kiwifb]

comment:8

I thought I had taken care of that. My apologies it will take a few hours until I can take care of them.

[kiwifb]

Attachment: trac_11377-extraflint-dependencies.patch.gz

I missed a number of flint dependencies in the original patch. Apply trac_11377-build_module_listpy.patchafter

[kiwifb]

comment:9

It turns out I had missed another instance of flint in sage.set.disjoints.set. So the additional patch takes care of it. It was all done on top of alpha2, hopefully there is nothing wrecking it already in alpha3.

[kiwifb]

comment:10

In the last patch description the word after shouldn't have come last. It is applied after trac_11377-build_module_listpy.patch.

[vbraun]

Reviewer: Volker Braun

[vbraun]

comment:11

Looks great!

[jdemeyer]

Merged: sage-4.7.1.alpha4

[nexttime]

comment:14

Would have been nice if you'd cc'ed me ;-) (as I have introduced SAGE_INC :-) and always been interested in cleaning the whole mess up, not to mention tickets like #8664, #9914, or the "final" trouble with #4000 ...).

Robert B. originally planned (about 14+ month ago, cf. e.g. #7987) to "automate" most of what's currently hand-coded in module_list.py (by Cython pragmas local to the modules' files), so I mostly made changes that affect only small parts.

Btw, I may have missed something, but neither alpha4 (nor alpha3) have yet been announced; the README.FIRSTs still state

There is no point in testing it because the version can change any time.

[kiwifb]

comment:15

Hi Robert,

sorry I didn't know you had introduced it. I was vaguely aware of the existence of an effort like #7987 but didn't know the ticket or that a ticket was actually open.

I must say my primary aim was the elimination of reference to SAGE_ROOT which is a pain for sage-on-gentoo. And of course once started I had to clean the whole thing, I have been waiting for some time with my clean up patch I can tell you. So I am glad it got reviewed positively and all.

[nexttime]

comment:16

Replying to @kiwifb:

And of course once started I had to clean the whole thing, I have been waiting for some time with my clean up patch I can tell you. So I am glad it got reviewed positively and all.

And above all merged! Making larger changes to module_list.py is some kind of Sisyphean task since many tickets (unrelated to the build system) frequently modify parts of it.

Reducing the need for the latter should IMHO be the next step, as it somewhat thwarts concurrent, modular development and maintainability.

I've more than once spent days to figure out and remove useless dependencies (e.g. on libraries) last year, in some cases just to - not much later - see the effort being more or less in vain...