HPC GAP test failures

State of the GAP test suite in HPC-GAP

Below is an overview on the state of the test suite in HPC-GAP, with a list of known problems. In a few cases, names are listed indicating people who are looking into these issues (or at least were, during GAP Days Spring 2015).

The GAP test suite consists of several tests:

• tst/testinstall.g
• tst/testall.g
• tests of the manual examples, packages loading, etc...

Of course in addition to all this, we need to write more codes to increase the overall code coverage.

To start with, we are looking at tst/testinstall.g first.

Main thread, run testinstall.g once

Running the GAP test suite once in the main thread by now works reasonably well.

Main thread, run testinstall.g twice

Running the GAP test suite twice in the main thread produces some harmless failures (objects are printed differently because more information about them is known), but this is also the case in regular GAP. These should be fixed.

Single non-main thread, run testinstall.g once

Running the GAP test suite in a single thread also is quite good for all tests from testinstall.g except ctblmono.tst which produces errors starting with this:

5] ########> Diff in /Users/mhorn/Projekte/GAP/hpcgap/gap/tst/ctblmono.tst, line 33:
[5] # Input is:
[5] test:= TestHomogeneous( chi, n );;
[5] # Expected output:
[5] # But found:
[5] Error, Attempt to read object 4412121040 of type list (plain,cyc) withou\
[5] t having read access

Multiple threads, run tests in at least two.

The next stage (apart from writing many more tests ...) now is to run tests in multiple threads, in all kinds of variations: Run a single test (or the whole test suite) in the main thread; then afterwards (or in parallel) in another thread. Or vice versa, etc.

This uncovers many new problems, which need to be fixed. Note that some of them are just due to re-running tests, i.e. they also occur in GAP when running a test twice. To fix these, the tests should be adjusted.

Here is a list of files which experience problems, created by first running Read("tst/testinstall.g"); in the main thread, then afterwards running it again in another thread:

• algmat.tst
• ctblmono.tst,
• ffeconway.tst
• grpmat.tst
• mapping.tst
• relation.tst
• semigrp.tst
• vspchom.tst
• vspcrow.tst
• zmodnz.tst
• ...

Who is working on what?

In order to avoid duplicate effort, please state here if you are working on a specific tst file:

• ctblmono.tst: TODO
• ....