🚀 Feature: Broaden Acceptance Criteria Architecture to serve as Summary/Comparison Framework

[DavidOry]

User Story

The purpose of the Acceptance Criteria is to compare base year model outcomes to observed data as well as sensitivity tests to determine if the model's performance is "acceptable". The procedures required to create the Acceptance Criteria can be readily re-used to (a) summarize scenario outcomes and (b) compare scenarios to each other. The Acceptance Criteria's architecture should be modified to accommodate these two additional use cases.

Related: should these procedures be part of tm2py or a separate package? Being part of tm2py implies that the will need or require the tm2py Python environment, which, because of its relationship with Emme, will necessarily be complicated. It may be better to create a separate package, say tm2py-utils to house these procedures.

Progress:

• Sufficiently defined
• Approach determined
• Tests developed
• User story satisfied
• Doc strings
• General documentation
• Passing tests

Priority

Low

Level of Effort

Medium-Low

Resolution Ideas

Create a new comparison.py which creates Acceptance-like databases (to be rendered in Tableau) that compares two Scenarios. Add some options to Scenarios to allow users to run subsets of the comparisons.

Project

No funding at this time.

Who should be involved?

Users: @gregerhardt, @lmz, @FlaviaTsang
Reviewers: @e-lo, @i-am-sijia

Risk

Tests should confirm Acceptance Criteria summaries are not disturbed by the new comparisons.

Tests

• Test for recreating stable Acceptance Criteria summaries
• Test comparison of two scenarios