Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Audit of historical datasets #118

Open
89 of 91 tasks
jeanpaulrsoucy opened this issue Oct 5, 2023 · 1 comment
Open
89 of 91 tasks

Audit of historical datasets #118

jeanpaulrsoucy opened this issue Oct 5, 2023 · 1 comment
Labels
data New data sources or updates to existing data sources. planning

Comments

@jeanpaulrsoucy
Copy link
Member

jeanpaulrsoucy commented Oct 5, 2023 •
edited
Loading

Cases

  • AB
  • BC
  • MB
  • NB
  • NL
  • NS
  • NT
  • NU
  • ON
  • PE
  • QC
  • SK
  • YT

Deaths

  • AB
  • BC
  • MB
  • NB
  • NL
  • NS
  • NT
  • NU
  • ON
  • PE
  • QC
  • SK
  • YT

Hospitalizations

  • AB
  • BC
  • MB
  • NB
  • NL
  • NS
  • NT
  • NU
  • ON
  • PE
  • QC
  • SK
  • YT

ICU

  • AB
  • BC
  • MB
  • NB
  • NL
  • NS
  • NT
  • NU
  • ON
  • PE
  • QC
  • SK
  • YT

Hospital admissions

  • AB
  • BC
  • MB
  • NB
  • NL
  • NS
  • NT
  • NU
  • ON
  • PE
  • QC
  • SK
  • YT

ICU admissions

  • AB
  • BC
  • MB
  • NB
  • NL
  • NS
  • NT
  • NU
  • ON
  • PE
  • QC
  • SK
  • YT

Tests completed

  • AB
  • BC
  • MB
  • NB
  • NL
  • NS
  • NT
  • NU
  • ON
  • PE
  • QC
  • SK
  • YT
@jeanpaulrsoucy jeanpaulrsoucy added data New data sources or updates to existing data sources. planning labels Oct 5, 2023
@jeanpaulrsoucy jeanpaulrsoucy mentioned this issue Oct 5, 2023
Open
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Oct 12, 2023
@jeanpaulrsoucy
Switch to ON MOH dataset
29c4107 
- Advantages compared to PHO dataset: single dataset, daily data, more timely
- Disadvantages: could be retired at any time
- ccodwg/CovidTimelineCanada#118
jeanpaulrsoucy added a commit that referenced this issue Oct 12, 2023
@jeanpaulrsoucy
Update data: 2023-10-12 00:50 EDT
e75336b 
- Switch to ON MOH dataset (#118)
- Advantages compared to PHO dataset: single dataset, daily data, more timely
- Disadvantages: could be retired at any time
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaDataProcess that referenced this issue Oct 12, 2023
@jeanpaulrsoucy
Update QC deaths processing
1094323 
- Censor final three days of death data: "Les décès ayant eu lieu le dimanche, lundi et mardi précédent la mise en ligne du mercredi ne sont pas disponibles."
- ccodwg/CovidTimelineCanada#118
jeanpaulrsoucy added a commit that referenced this issue Oct 13, 2023
@jeanpaulrsoucy
Update BC report script (#95)
d090e3f 
- Include cumulative time series for cases, deaths, hosp_admissions, icu_admissions (#111, #118)
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Oct 13, 2023
@jeanpaulrsoucy
Update BC data
c8cd8a9 
- Update BC cases, deaths, hosp_admissions, icu_admissions to use cumulative time series from COVID-19 Situation Report (ccodwg/CovidTimelineCanada#118, ccodwg/CovidTimelineCanada#111)
- Update BC hospitalization, icu to use data from COVID-19 Situation Report (ccodwg/CovidTimelineCanada#82)
jeanpaulrsoucy added a commit that referenced this issue Oct 13, 2023
@jeanpaulrsoucy
Update data: 2023-10-13 18:46 EDT
ed5286e 
- Update BC cases, deaths, hosp_admissions, icu_admissions to use cumulative time series from COVID-19 Situation Report (#118, #111)
- Update BC hospitalization, icu to use data from COVID-19 Situation Report (#82)
@jeanpaulrsoucy jeanpaulrsoucy mentioned this issue Oct 14, 2023
Closed
20 tasks
jeanpaulrsoucy added a commit that referenced this issue Oct 14, 2023
@jeanpaulrsoucy
Update data: 2023-10-14 16:09 EDT
5179af6 
- Update SK deaths to use PHAC dataset from 2022-07-02 onward (#81, #118)
- Cumulative deaths from original dataset (cumulative TS + weekly report w/ non-cumulative values) have good agreement with cumulative deaths from PHAC cumulative TS on 2022-06-25: 1426 / 1427; but later the two datasets deviate significantly (with PHAC having more deaths); replace original dataset w/ PHAC dataset beginning 2022-07-02 since original dataset has no HR-level data after 2022-06-25 anyway
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Oct 14, 2023
@jeanpaulrsoucy
Update SK deaths to use PHAC dataset from 2022-07-02 onward
1f35d0f 
- ccodwg/CovidTimelineCanada#81
- ccodwg/CovidTimelineCanada#118
@jeanpaulrsoucy jeanpaulrsoucy pinned this issue Nov 2, 2023
jeanpaulrsoucy added a commit that referenced this issue Apr 14, 2024
@jeanpaulrsoucy
Update data: 2024-04-13 19:59 EDT
86d700b 
- Update ON HR-level deaths (#118) and hospital admissions (#118, #111) with latest data update from 2024-04-12 (for retroactive data updates, which are significant for the latest data, i.e., December 2023)
- Update ON data update script for cases, outcomes (#95)
jeanpaulrsoucy added a commit that referenced this issue Apr 14, 2024
@jeanpaulrsoucy
Update data: 2024-04-13 21:45 EDT
4371614 
- Update BC case, death, testing (#118) and hospital/ICU admission data (#111) with latest data update from 2024-04-11 (for retroactive data updates)
- Update BC data update script for cumulative data (#95)
@jeanpaulrsoucy
Copy link
Member Author

Should re-check datasets that continued retroactive data updates after the end of 2023, for example ON ICU data (#130) and provinces using PHAC data for cases/deaths.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
data New data sources or updates to existing data sources. planning
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jeanpaulrsoucy