Skip to content

Commit

Permalink
Minor enhancements to yaml test descriptions (#726)
Browse files Browse the repository at this point in the history
  • Loading branch information
Gabeblis authored Sep 25, 2024
1 parent 5699d00 commit f6977a6
Show file tree
Hide file tree
Showing 71 changed files with 71 additions and 159 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -113,7 +113,7 @@
<expect id="has-data-flow" target="system-characteristics" test="data-flow" level="WARNING">
<message>A FedRAMP SSP must include a data flow section.</message>
</expect>
<expect id="has-data-flow-diagram" target="system-characteristics/data-flow" test="diagram" level="ERROR">
<expect id="has-data-flow-diagram" target="system-characteristics/data-flow" test="diagram" level="WARNING">
<message>A FedRAMP SSP must have at least one data flow diagram.</message>
</expect>
<expect id="has-data-flow-description" target="system-characteristics/data-flow" test="description" level="ERROR">
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for categorization-has-correct-system-attribute
description: >-
This test case validates the behavior of constraint
categorization-has-correct-system-attribute
description: Test that a SSP system-characteristics categorization element does not have a system attribute equal to "https://doi.org/10.6028/NIST.SP.800-60v2r1".
content: ../content/ssp-categorization-has-correct-system-attribute-INVALID.xml
expectations:
- constraint-id: categorization-has-correct-system-attribute
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for categorization-has-correct-system-attribute
description: >-
This test case validates the behavior of constraint
categorization-has-correct-system-attribute
description: Test that a SSP system-characteristics categorization element has a system attribute equal to "https://doi.org/10.6028/NIST.SP.800-60v2r1".
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: categorization-has-correct-system-attribute
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for categorization-has-information-type-id
description: >-
This test case validates the behavior of constraint
categorization-has-information-type-id
description: Test that a SSP system-characteristics categorization element does not have an information-type-id element.
content: ../content/ssp-categorization-has-information-type-id-INVALID.xml
expectations:
- constraint-id: categorization-has-information-type-id
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for categorization-has-information-type-id
description: >-
This test case validates the behavior of constraint
categorization-has-information-type-id
description: Test that a SSP system-characteristics categorization element has an information-type-id element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: categorization-has-information-type-id
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for has-authenticator-assurance-level
description: >-
This test case validates the behavior of constraint
has-authenticator-assurance-level
description: Test that a SSP system-characteristics element does not have a prop with a name equal to "authenticator-assurance-level".
content: ../content/ssp-has-authenticator-assurance-level-INVALID.xml
expectations:
- constraint-id: has-authenticator-assurance-level
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for has-authenticator-assurance-level
description: >-
This test case validates the behavior of constraint
has-authenticator-assurance-level
description: Test that a SSP system-characteristics element does not have a prop with a name equal to "authenticator-assurance-level".
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-authenticator-assurance-level
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for has-authorization-boundary-diagram
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram
description: Test that a SSP authorization-boundary element does not have a diagram element.
content: ../content/ssp-has-authorization-boundary-diagram-INVALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for has-authorization-boundary-diagram
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram
description: Test that a SSP system-characteristics element has an authorization-boundary diagram element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for has-authorization-boundary-diagram-caption
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram-caption
description: Test that a SSP authorization-boundary diagram element does not have a caption element.
content: ../content/ssp-has-authorization-boundary-diagram-caption-INVALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram-caption
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for has-authorization-boundary-diagram-caption
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram-caption
description: Test that a SSP authorization-boundary diagram element has a caption element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram-caption
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for has-authorization-boundary-diagram-description
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram-description
description: Test that a SSP authorization-boundary diagram element does not have a description element.
content: ../content/ssp-has-authorization-boundary-diagram-description-INVALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram-description
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for has-authorization-boundary-diagram-description
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram-description
description: Test that a SSP authorization-boundary diagram element has a description element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram-description
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for has-authorization-boundary-diagram-link
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram-link
description: Test that a SSP authorization-boundary diagram element does not have a link element.
content: ../content/ssp-has-authorization-boundary-diagram-link-INVALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram-link
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for has-authorization-boundary-diagram-link
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram-link
description: Test that a SSP authorization-boundary diagram element does not have a link element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram-link
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for has-authorization-boundary-diagram-link-rel
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram-link-rel
description: Test that a SSP authorization-boundary diagram link element does not have a rel attribute.
content: ../content/ssp-has-authorization-boundary-diagram-link-rel-INVALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram-link-rel
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for has-authorization-boundary-diagram-link-rel
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram-link-rel
description: Test that a SSP authorization-boundary diagram link element has a rel attribute.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram-link-rel
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for has-authorization-boundary-diagram-link-rel-allowed-value
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram-link-rel-allowed-value
description: Test that a SSP authorization-boundary diagram link rel attribute does not equal "diagram".
content: ../content/ssp-has-authorization-boundary-diagram-link-rel-allowed-value-INVALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram-link-rel-allowed-value
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for has-authorization-boundary-diagram-link-rel-allowed-value
description: >-
This test case validates the behavior of constraint
has-authorization-boundary-diagram-link-rel-allowed-value
description: Test that a SSP authorization-boundary diagram link rel attribute equals "diagram".
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-authorization-boundary-diagram-link-rel-allowed-value
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for has-configuration-management-plan
description: >-
This test case validates the behavior of constraint
has-configuration-management-plan
description: Test that a SSP back-matter resource element does not have a configuration-management-plan element.
content: ../content/ssp-has-configuration-management-plan-INVALID.xml
expectations:
- constraint-id: has-configuration-management-plan
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for has-configuration-management-plan
description: >-
This test case validates the behavior of constraint
has-configuration-management-plan
description: Test that a SSP back-matter resource element has a configuration-management-plan element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-configuration-management-plan
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Negative Test for has-data-flow
description: Test that system-characteristics does not have a data-flow element.
description: Test that a SSP system-characteristics element does not have a data-flow element.
content: ../content/ssp-has-data-flow-INVALID.xml
expectations:
- constraint-id: has-data-flow
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Positive Test for has-data-flow
description: Test that system-characteristics has a data-flow element.
description: Test that a SSP system-characteristics element has a data-flow element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-data-flow
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Negative Test for has-data-flow-description
description: Test that data-flow does not have a description.
description: Test that a SSP data-flow element does not have a description element.
content: ../content/ssp-has-data-flow-description-INVALID.xml
expectations:
- constraint-id: has-data-flow-description
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Positive Test for has-data-flow-description
description: Test that data-flow does not have a description.
description: Test that a SSP data-flow element does not have a description element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-data-flow-description
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Negative Test for has-data-flow-diagram
description: Test that data-flow does not have a diagram.
description: Test that a SSP data-flow element does not have a diagram element.
content: ../content/ssp-has-data-flow-diagram-INVALID.xml
expectations:
- constraint-id: has-data-flow-diagram
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Positive Test for has-data-flow-diagram
description: Test that data-flow has a diagram.
description: Test that a SSP data-flow element has a diagram element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-data-flow-diagram
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Negative Test for has-data-flow-diagram-caption
description: Test that data-flow diagram does not have a caption.
description: Test that a SSP data-flow diagram element does not have a caption element.
content: ../content/ssp-has-data-flow-diagram-caption-INVALID.xml
expectations:
- constraint-id: has-data-flow-diagram-caption
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Positive Test for has-data-flow-diagram-caption
description: Test that data-flow diagram has a caption.
description: Test that a SSP data-flow diagram element has a caption element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-data-flow-diagram-caption
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Negative Test for has-data-flow-diagram-description
description: Test that data-flow diagram does not have a description.
description: Test that a SSP data-flow diagram element does not have a description element.
content: ../content/ssp-has-data-flow-diagram-description-INVALID.xml
expectations:
- constraint-id: has-data-flow-diagram-description
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Positive Test for has-data-flow-diagram-description
description: Test that data-flow diagram has a description.
description: Test that a SSP data-flow diagram element has a description element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-data-flow-diagram-description
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Negative Test for has-data-flow-diagram-link
description: Test that data-flow diagram does not have a link.
description: Test that a SSP data-flow diagram element does not have a link element.
content: ../content/ssp-has-data-flow-diagram-link-INVALID.xml
expectations:
- constraint-id: has-data-flow-diagram-link
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Positive Test for has-data-flow-diagram-link
description: Test that data-flow diagram has a link.
description: Test that a SSP data-flow diagram element has a link element.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-data-flow-diagram-link
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Negative Test for has-data-flow-diagram-link-rel
description: Test that data-flow diagram link does not have a rel attribute.
description: Test that a SSP data-flow diagram link element does not have a rel attribute.
content: ../content/ssp-has-data-flow-diagram-link-rel-INVALID.xml
expectations:
- constraint-id: has-data-flow-diagram-link-rel
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Positive Test for has-data-flow-diagram-link-rel
description: Test that data-flow diagram link has a rel attribute.
description: Test that a SSP data-flow diagram link element has a rel attribute.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-data-flow-diagram-link-rel
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Negative Test for has-data-flow-diagram-link-rel-allowed-value
description: Test that data-flow diagram link rel attribute does not equal "diagram".
description: Test that a SSP data-flow diagram link rel attribute does not equal "diagram".
content: ../content/ssp-has-data-flow-diagram-link-rel-allowed-value-INVALID.xml
expectations:
- constraint-id: has-data-flow-diagram-link-rel-allowed-value
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Positive Test for has-data-flow-diagram-link-rel-allowed-value
description: Test that data-flow diagram link rel attribute equals "diagram".
description: Test that a SSP data-flow diagram link rel attribute equals "diagram".
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-data-flow-diagram-link-rel-allowed-value
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Negative Test for has-data-flow-diagram-uuid
description: Test that data-flow diagram does not have a uuid attribute.
description: Test that a SSP data-flow diagram element does not have a uuid attribute.
content: ../content/ssp-has-data-flow-diagram-uuid-INVALID.xml
expectations:
- constraint-id: has-data-flow-diagram-uuid
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
test-case:
name: Positive Test for has-data-flow-diagram-uuid
description: Test that data-flow diagram has a uuid attribute.
description: Test that a SSP data-flow diagram element has a uuid attribute.
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-data-flow-diagram-uuid
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for has-federation-assurance-level
description: >-
This test case validates the behavior of constraint
has-federation-assurance-level
description: Test that a SSP system-characteristics element does not have a prop with a name equal to "federation-assurance-level".
content: ../content/ssp-has-federation-assurance-level-INVALID.xml
expectations:
- constraint-id: has-federation-assurance-level
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for has-federation-assurance-level
description: >-
This test case validates the behavior of constraint
has-federation-assurance-level
description: Test that a SSP system-characteristics element has a prop with a name equal to "federation-assurance-level".
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-federation-assurance-level
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Negative Test for has-identity-assurance-level
description: >-
This test case validates the behavior of constraint
has-identity-assurance-level
description: Test that a SSP system-characteristics element does not have a prop with a name equal to "identity-assurance-level".
content: ../content/ssp-has-identity-assurance-level-INVALID.xml
expectations:
- constraint-id: has-identity-assurance-level
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
test-case:
name: Positive Test for has-identity-assurance-level
description: >-
This test case validates the behavior of constraint
has-identity-assurance-level
description: Test that a SSP system-characteristics element has a prop with a name equal to "identity-assurance-level".
content: ../content/ssp-all-VALID.xml
expectations:
- constraint-id: has-identity-assurance-level
Expand Down
Loading

0 comments on commit f6977a6

Please sign in to comment.