Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SC + ITS: quantitative outputs #19

Closed
1 of 4 tasks
drbenvincent opened this issue Oct 26, 2022 · 1 comment · Fixed by #355
Closed
1 of 4 tasks

SC + ITS: quantitative outputs #19

drbenvincent opened this issue Oct 26, 2022 · 1 comment · Fixed by #355
Labels
outputs Quantitative outputs of the model

Comments

@drbenvincent
Copy link
Collaborator

drbenvincent commented Oct 26, 2022

Need to provide quantitative outputs/reports for synthetic control and interrupted time series.

The Causal Impact package provides these summary stats:
Screenshot 2022-11-19 at 12 49 32

For the frequentist version: Add ability to test for presence/absence of causal impact. There is a traditional way of doing this, but we could also envisage bootstrap on the pre-intervention data.

TODO

  • add summary stats for Bayesian ITS + SC (first pass)
  • add relative impact as well as absolute
  • Implement a better API
  • add summary stats for Frequentist ITS + SC
@drbenvincent drbenvincent added the outputs Quantitative outputs of the model label Oct 30, 2022
@drbenvincent drbenvincent changed the title Synthetic control: significance of effect SC + ITS: quantitative outputs Oct 30, 2022
drbenvincent added a commit that referenced this issue Nov 19, 2022
@drbenvincent
Copy link
Collaborator Author

As of now, this is what we have for getting outputs /summary stats. It's a good start, but we need to make the API better :)

Screenshot 2022-11-19 at 13 43 40

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
outputs Quantitative outputs of the model
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant