Custom test runners do not copy test files in directories.

[tmcgilchrist]

Expected Behaviour

Given a setup of this custom diff executable:

;; Custom diff executable.
(executable
 (package gitlab-unix)
 (libraries gitlab-unix cmdliner)
 (public_name diff)
 (modules diff)
 (name diff))

; Run diff.exe on each GitLab sample json from test/cases/

(rule
 (with-stdout-to events_output.json
  (run ./diff.exe events)))

(rule
 (alias runtest)
 (action
  (diff cases/events/expected.json events_output.json)))

This directory structure

test
├── cases
│   └── events
│       ├── event.json
│       └── expected.json
├── diff.ml
└── dune

I expected that cases/events/expected.json would be available under _build directory or to have an option to include them.

Actual Behavior

$ dune runtest       
        diff test/events_output.json (exit 1)
(cd _build/default/test && ./diff.exe events) > _build/default/test/events_output.json
diff: internal error, uncaught exception:
      Sys_error("cases/events/event.json: No such file or directory")

$ ls _build/default/test 
diff.exe  diff.ml

If the diff behaviour is written as a test like this with a source_tree deps the files
will get copied over and be available under _build.

 (test
  (name test)
  (package gitlab-unix)
  (libraries gitlab-unix alcotest)
  (modules test)
  (deps
   (source_tree cases)))

Specifications

$ dune --version
2.9.1
$ ocamlc --version
4.12.1
$ sw_vers 
ProductName:	macOS
ProductVersion:	11.6.2
BuildVersion:	20G314

[rgrinberg]

The following rule:

(rule
 (with-stdout-to events_output.json
  (run ./diff.exe events)))

Attempts to read cases/events/event.json but does not declare a dependency on this file. You can amend the rule to declare the dependency with the long form for rules:

(rule
 (deps cases/events/event.json)
 (action
  (with-stdout-to events_output.json (run ./diff.exe events))))

Cheers.

[tmcgilchrist]

Thanks @rgrinberg