conformance results

Duke-GCB · Nov 23, 2023 · c933931 · c933931
1 parent 3459420
commit c933931
Show file tree

Hide file tree

Showing 71 changed files with 9,186 additions and 847 deletions.
diff --git a/conformance/README.md b/conformance/README.md
@@ -101,6 +101,43 @@ The manifests are ready for a minikube local cluster.
 ![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/1.2.1/subworkflow.json?icon=commonwl)
 ![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/1.2.1/timelimit.json?icon=commonwl)
 
+
+## Conformance tests for CWL v1.2.1 (proposed) for the latest release
+
+### Classes
+
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/workflow.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/command_line_tool.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/expression_tool.json?icon=commonwl)
+
+### Required features
+
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/required.json?icon=commonwl)
+
+### Optional features
+
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/conditional.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/docker.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/env_var.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/format_checking.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/initial_work_dir.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/inline_javascript.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/inplace_update.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/input_object_requirements.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/multiple.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/multiple_input.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/networkaccess.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/resource.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/scatter.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/schema_def.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/secondary_files.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/shell_command.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/step_input.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/step_input_expression.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/subworkflow.json?icon=commonwl)
+![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/conformance-1.2.1/conformance/badges/badges-1.2.1_proposed/timelimit.json?icon=commonwl)
+
+
 ## Run the conformance tests on Minikube
 
 ### Cluster Preparation

diff --git a/conformance/StageConformanceTestsData.yaml b/conformance/StageConformanceTestsData.yaml
@@ -1,27 +1,3 @@
-apiVersion: v1
-kind: PersistentVolumeClaim
-metadata:
-  name: conformance-test-data
-spec:
-  accessModes:
-  - ReadWriteMany
-  resources:
-    requests:
-      storage: 1Gi
-  storageClassName: standard
----
-apiVersion: v1
-kind: PersistentVolumeClaim
-metadata:
-  name: conformance-test-output
-spec:
-  accessModes:
-  - ReadWriteMany
-  resources:
-    requests:
-      storage: 1Gi
-  storageClassName: standard
----
 apiVersion: batch/v1
 kind: Job
 metadata:

diff --git a/conformance/Volumes.yaml b/conformance/Volumes.yaml
@@ -0,0 +1,23 @@
+apiVersion: v1
+kind: PersistentVolumeClaim
+metadata:
+  name: conformance-test-output
+spec:
+  accessModes:
+  - ReadWriteMany
+  resources:
+    requests:
+      storage: 1Gi
+  storageClassName: standard
+---
+apiVersion: v1
+kind: PersistentVolumeClaim
+metadata:
+  name: conformance-test-data
+spec:
+  accessModes:
+  - ReadWriteMany
+  resources:
+    requests:
+      storage: 1Gi
+  storageClassName: standard
diff --git a/conformance/badges/1.0.2/command_line_tool.json b/conformance/badges/1.0.2/command_line_tool.json
diff --git a/conformance/badges/1.0.2/docker.json b/conformance/badges/1.0.2/docker.json
diff --git a/conformance/badges/1.0.2/initial_work_dir.json b/conformance/badges/1.0.2/initial_work_dir.json
diff --git a/conformance/badges/1.0.2/inline_javascript.json b/conformance/badges/1.0.2/inline_javascript.json
diff --git a/conformance/badges/1.0.2/resource.json b/conformance/badges/1.0.2/resource.json
diff --git a/...mance/badges/1.2.1/command_line_tool.json → ...mance/badges/1.2.0/command_line_tool.json b/...mance/badges/1.2.1/command_line_tool.json → ...mance/badges/1.2.0/command_line_tool.json
diff --git a/conformance/badges/1.2.1/conditional.json → conformance/badges/1.2.0/conditional.json b/conformance/badges/1.2.1/conditional.json → conformance/badges/1.2.0/conditional.json
diff --git a/conformance/badges/1.2.1/docker.json → conformance/badges/1.2.0/docker.json b/conformance/badges/1.2.1/docker.json → conformance/badges/1.2.0/docker.json
diff --git a/conformance/badges/1.0.2/env_var.json → conformance/badges/1.2.0/env_var.json b/conformance/badges/1.0.2/env_var.json → conformance/badges/1.2.0/env_var.json
diff --git a/...ormance/badges/1.0.2/expression_tool.json → ...ormance/badges/1.2.0/expression_tool.json b/...ormance/badges/1.0.2/expression_tool.json → ...ormance/badges/1.2.0/expression_tool.json
diff --git a/...ormance/badges/1.2.1/format_checking.json → ...ormance/badges/1.2.0/format_checking.json b/...ormance/badges/1.2.1/format_checking.json → ...ormance/badges/1.2.0/format_checking.json
diff --git a/...rmance/badges/1.2.1/initial_work_dir.json → ...rmance/badges/1.2.0/initial_work_dir.json b/...rmance/badges/1.2.1/initial_work_dir.json → ...rmance/badges/1.2.0/initial_work_dir.json
diff --git a/...mance/badges/1.2.1/inline_javascript.json → ...mance/badges/1.2.0/inline_javascript.json b/...mance/badges/1.2.1/inline_javascript.json → ...mance/badges/1.2.0/inline_javascript.json
diff --git a/conformance/badges/1.2.1/inplace_update.json → conformance/badges/1.2.0/inplace_update.json b/conformance/badges/1.2.1/inplace_update.json → conformance/badges/1.2.0/inplace_update.json
diff --git a/...dges/1.2.1/input_object_requirements.json → ...dges/1.2.0/input_object_requirements.json b/...dges/1.2.1/input_object_requirements.json → ...dges/1.2.0/input_object_requirements.json
diff --git a/conformance/badges/1.2.1/multiple.json → conformance/badges/1.2.0/multiple.json b/conformance/badges/1.2.1/multiple.json → conformance/badges/1.2.0/multiple.json
diff --git a/conformance/badges/1.0.2/multiple_input.json → conformance/badges/1.2.0/multiple_input.json b/conformance/badges/1.0.2/multiple_input.json → conformance/badges/1.2.0/multiple_input.json
diff --git a/conformance/badges/1.2.1/networkaccess.json → conformance/badges/1.2.0/networkaccess.json b/conformance/badges/1.2.1/networkaccess.json → conformance/badges/1.2.0/networkaccess.json
diff --git a/conformance/badges/1.0.2/required.json → conformance/badges/1.2.0/required.json b/conformance/badges/1.0.2/required.json → conformance/badges/1.2.0/required.json
diff --git a/conformance/badges/1.2.1/resource.json → conformance/badges/1.2.0/resource.json b/conformance/badges/1.2.1/resource.json → conformance/badges/1.2.0/resource.json
diff --git a/conformance/badges/1.0.2/scatter.json → conformance/badges/1.2.0/scatter.json b/conformance/badges/1.0.2/scatter.json → conformance/badges/1.2.0/scatter.json
diff --git a/conformance/badges/1.0.2/schema_def.json → conformance/badges/1.2.0/schema_def.json b/conformance/badges/1.0.2/schema_def.json → conformance/badges/1.2.0/schema_def.json
diff --git a/...ormance/badges/1.2.1/secondary_files.json → ...ormance/badges/1.2.0/secondary_files.json b/...ormance/badges/1.2.1/secondary_files.json → ...ormance/badges/1.2.0/secondary_files.json
diff --git a/conformance/badges/1.0.2/shell_command.json → conformance/badges/1.2.0/shell_command.json b/conformance/badges/1.0.2/shell_command.json → conformance/badges/1.2.0/shell_command.json
diff --git a/conformance/badges/1.0.2/step_input.json → conformance/badges/1.2.0/step_input.json b/conformance/badges/1.0.2/step_input.json → conformance/badges/1.2.0/step_input.json
diff --git a/...e/badges/1.0.2/step_input_expression.json → ...e/badges/1.2.0/step_input_expression.json b/...e/badges/1.0.2/step_input_expression.json → ...e/badges/1.2.0/step_input_expression.json
diff --git a/conformance/badges/1.0.2/subworkflow.json → conformance/badges/1.2.0/subworkflow.json b/conformance/badges/1.0.2/subworkflow.json → conformance/badges/1.2.0/subworkflow.json
diff --git a/conformance/badges/1.2.1/timelimit.json → conformance/badges/1.2.0/timelimit.json b/conformance/badges/1.2.1/timelimit.json → conformance/badges/1.2.0/timelimit.json
diff --git a/conformance/badges/1.0.2/workflow.json → conformance/badges/1.2.0/workflow.json b/conformance/badges/1.0.2/workflow.json → conformance/badges/1.2.0/workflow.json
diff --git a/conformance/badges/1.2.1/required.json b/conformance/badges/1.2.1/required.json
diff --git a/conformance/badges/1.2.1/step_input_expression.json b/conformance/badges/1.2.1/step_input_expression.json
diff --git a/conformance/badges/1.2.1/workflow.json b/conformance/badges/1.2.1/workflow.json
diff --git a/conformance/badges/badges-1.2.1_proposed/command_line_tool.json b/conformance/badges/badges-1.2.1_proposed/command_line_tool.json
@@ -0,0 +1 @@
+{"subject": "command_line_tool", "status": "92%", "color": "yellow"}
diff --git a/conformance/badges/badges-1.2.1_proposed/conditional.json b/conformance/badges/badges-1.2.1_proposed/conditional.json
@@ -0,0 +1 @@
+{"subject": "conditional", "status": "100%", "color": "green"}
diff --git a/conformance/badges/badges-1.2.1_proposed/docker.json b/conformance/badges/badges-1.2.1_proposed/docker.json
@@ -0,0 +1 @@
+{"subject": "docker", "status": "81%", "color": "yellow"}
diff --git a/conformance/badges/1.2.1/env_var.json → ...badges/badges-1.2.1_proposed/env_var.json b/conformance/badges/1.2.1/env_var.json → ...badges/badges-1.2.1_proposed/env_var.json
diff --git a/...ormance/badges/1.2.1/expression_tool.json → ...adges-1.2.1_proposed/expression_tool.json b/...ormance/badges/1.2.1/expression_tool.json → ...adges-1.2.1_proposed/expression_tool.json
diff --git a/conformance/badges/badges-1.2.1_proposed/format_checking.json b/conformance/badges/badges-1.2.1_proposed/format_checking.json
@@ -0,0 +1 @@
+{"subject": "format_checking", "status": "100%", "color": "green"}
diff --git a/conformance/badges/badges-1.2.1_proposed/initial_work_dir.json b/conformance/badges/badges-1.2.1_proposed/initial_work_dir.json
@@ -0,0 +1 @@
+{"subject": "initial_work_dir", "status": "86%", "color": "yellow"}
diff --git a/conformance/badges/badges-1.2.1_proposed/inline_javascript.json b/conformance/badges/badges-1.2.1_proposed/inline_javascript.json
@@ -0,0 +1 @@
+{"subject": "inline_javascript", "status": "98%", "color": "yellow"}
diff --git a/conformance/badges/badges-1.2.1_proposed/inplace_update.json b/conformance/badges/badges-1.2.1_proposed/inplace_update.json
@@ -0,0 +1 @@
+{"subject": "inplace_update", "status": "0%", "color": "yellow"}
diff --git a/conformance/badges/badges-1.2.1_proposed/input_object_requirements.json b/conformance/badges/badges-1.2.1_proposed/input_object_requirements.json
@@ -0,0 +1 @@
+{"subject": "input_object_requirements", "status": "100%", "color": "green"}
diff --git a/conformance/badges/badges-1.2.1_proposed/json_schema_invalid.json b/conformance/badges/badges-1.2.1_proposed/json_schema_invalid.json
@@ -0,0 +1 @@
+{"subject": "json_schema_invalid", "status": "100%", "color": "green"}
diff --git a/conformance/badges/badges-1.2.1_proposed/load_listing.json b/conformance/badges/badges-1.2.1_proposed/load_listing.json
@@ -0,0 +1 @@
+{"subject": "load_listing", "status": "100%", "color": "green"}
diff --git a/conformance/badges/badges-1.2.1_proposed/multiple.json b/conformance/badges/badges-1.2.1_proposed/multiple.json
@@ -0,0 +1 @@
+{"subject": "multiple", "status": "100%", "color": "green"}
diff --git a/conformance/badges/1.2.1/multiple_input.json → ...badges-1.2.1_proposed/multiple_input.json b/conformance/badges/1.2.1/multiple_input.json → ...badges-1.2.1_proposed/multiple_input.json
diff --git a/conformance/badges/badges-1.2.1_proposed/networkaccess.json b/conformance/badges/badges-1.2.1_proposed/networkaccess.json
@@ -0,0 +1 @@
+{"subject": "networkaccess", "status": "50%", "color": "yellow"}
diff --git a/conformance/badges/badges-1.2.1_proposed/require.json b/conformance/badges/badges-1.2.1_proposed/require.json
@@ -0,0 +1 @@
+{"subject": "require", "status": "100%", "color": "green"}
diff --git a/conformance/badges/badges-1.2.1_proposed/required.json b/conformance/badges/badges-1.2.1_proposed/required.json
@@ -0,0 +1 @@
+{"subject": "required", "status": "96%", "color": "red"}
diff --git a/conformance/badges/badges-1.2.1_proposed/resource.json b/conformance/badges/badges-1.2.1_proposed/resource.json
@@ -0,0 +1 @@
+{"subject": "resource", "status": "81%", "color": "yellow"}
diff --git a/conformance/badges/1.2.1/scatter.json → ...badges/badges-1.2.1_proposed/scatter.json b/conformance/badges/1.2.1/scatter.json → ...badges/badges-1.2.1_proposed/scatter.json
diff --git a/conformance/badges/1.2.1/schema_def.json → ...ges/badges-1.2.1_proposed/schema_def.json b/conformance/badges/1.2.1/schema_def.json → ...ges/badges-1.2.1_proposed/schema_def.json
diff --git a/conformance/badges/badges-1.2.1_proposed/secondary_files.json b/conformance/badges/badges-1.2.1_proposed/secondary_files.json
@@ -0,0 +1 @@
+{"subject": "secondary_files", "status": "100%", "color": "green"}
diff --git a/conformance/badges/1.2.1/shell_command.json → .../badges-1.2.1_proposed/shell_command.json b/conformance/badges/1.2.1/shell_command.json → .../badges-1.2.1_proposed/shell_command.json
diff --git a/conformance/badges/1.2.1/step_input.json → ...ges/badges-1.2.1_proposed/step_input.json b/conformance/badges/1.2.1/step_input.json → ...ges/badges-1.2.1_proposed/step_input.json
diff --git a/conformance/badges/1.2.1/subworkflow.json → ...es/badges-1.2.1_proposed/subworkflow.json b/conformance/badges/1.2.1/subworkflow.json → ...es/badges-1.2.1_proposed/subworkflow.json
diff --git a/conformance/badges/badges-1.2.1_proposed/timelimit.json b/conformance/badges/badges-1.2.1_proposed/timelimit.json
@@ -0,0 +1 @@
+{"subject": "timelimit", "status": "55%", "color": "yellow"}
diff --git a/conformance/badges/badges-1.2.1_proposed/work_reuse.json b/conformance/badges/badges-1.2.1_proposed/work_reuse.json
@@ -0,0 +1 @@
+{"subject": "work_reuse", "status": "40%", "color": "yellow"}
diff --git a/conformance/badges/badges-1.2.1_proposed/workflow.json b/conformance/badges/badges-1.2.1_proposed/workflow.json
@@ -0,0 +1 @@
+{"subject": "workflow", "status": "97%", "color": "yellow"}