5am unable to find any tests under Alive (vs-code extension).

[czaky]

Summary

5am runner does not find any tests when run in the Alive (vs-code) environment.
Any ideas or pointers where we should look to figure this out?

(This issue was also cross-posted to: nobody-famous/alive#200 for visibility.)

Symptom

From Alive REPL:

> (asdf:test-system :puzzles/test)
 Didn't run anything...huh?

> (5am:run-all-tests)
 Didn't run anything...huh?

Crosscheck

This works with emacs and sbcl or from the command-line.

ros run --noinform --non-interactive -e "(require :asdf)" \
  -e "(progn (load \"puzzles.asd\") (uiop:quit (if (asdf:test-system :puzzles/test) 0 -1)))"

Running test suite PUZZLES
 Running test TWICE-LINEAR ...
 Did 3 checks.
    Pass: 3 (100%)
    Skip: 0 ( 0%)
    Fail: 0 ( 0%)

ASDF file for completness

(asdf:defsystem :puzzles
  :description "Puzzle Solutions."
  :licence "MIT"
  :serial t
  :components ((:file "math"))
  :in-order-to ((asdf:test-op (asdf:test-op :puzzles/test))))

(asdf:defsystem :puzzles/test
  :description "Puzzles test suite."
  :licence "MIT"
  :depends-on (:puzzles :fiveam)
  :components ((:file "test-math"))
  :perform (asdf:test-op (o c) (uiop:symbol-call :5am :run! :puzzles)))

Installation Steps

The installation follows the steps:

• Install roswell
• Install alive
• Configure alive

Roswell

There is no installer for roswell in the debian repository.
The easiest way is to compile from scratch using git sources.

The script below uses sbcl-bin/2.4.2 in order to use the jupyter kernel.

# Create git installation directory.
cd
mkdir -p git
cd git
# Install prerequisites
sudo apt-get -y install git build-essential automake libcurl4-openssl-dev
git clone -b release https://github.com/roswell/roswell.git
cd roswell
sh bootstrap
./configure
make
sudo make install
# Install environment under $USER/roswell
ros setup
# Select a working SBCL.
ros install sbcl-bin/2.4.2
ros use sbcl-bin/2.4.2
# Add roswell to the PATH
echo 'export PATH=$PATH:~/.roswell/bin' >> ~/.bashrc

Alive

Install alive-lsp as a local quicklisp project.

cd ~/.roswell/lisp/quicklisp/local-projects
git clone https://github.com/nobody-famous/alive-lsp.git

Test the alive server using:

ros run --eval '(require :asdf)' --eval '(asdf:load-system :alive-lsp)' --eval '(alive/server:start)'

Add the proper alive start command into the settings.json:

{
  "alive.lsp.startCommand": [
    "ros",
    "run",
    "--eval",
    "(require :asdf)",
    "--eval",
    "(asdf:load-system :alive-lsp)",
    "--eval",
    "(alive/server:start)"
  ],
}