Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add new value: hospital/ICU admissions #111

Open
9 of 12 tasks
jeanpaulrsoucy opened this issue Aug 13, 2023 · 13 comments
Open
9 of 12 tasks

Add new value: hospital/ICU admissions #111

jeanpaulrsoucy opened this issue Aug 13, 2023 · 13 comments
Labels
data New data sources or updates to existing data sources. P2 - Low priority Low priority updates

Comments

@jeanpaulrsoucy
Copy link
Member

jeanpaulrsoucy commented Aug 13, 2023

Many provinces replaced active hospitalizations/ICU numbers with hospital/ICU admissions (usually weekly) (#82). These should be added, potentially as hospitalizations_admissions and icu_admissions (original idea: hospitalizations_new and icu_new, but this may be confusing). As well, hospitalizations and icu should probably be changed to hospitalizations_active and icu_active (or perhaps "current" or "occupancy"; "hospitalizations" should be shortened to "hosp"), but maybe it's too late to change these values.

Will also need to add these values to the README and values.json, although they should be labelled experimental.

  • NS admissions time series (ae74c46f-dec7-43d6-a42b-86c7242f0868)
  • NL admissions archive_ts daily/weekly values (34f45670-34ed-415c-86a6-e14d77fcf6db)
  • NB admissions archive_ts cumulative values (40d93d2b-5c85-4592-b844-fb78b5ae5cec) ~~ (Has "total hospitalized and "total discharged" values but they are much larger than the cumulative values given in the subsequent reports---probably a definition change, and so it doesn't make sense to report negative cumulative values, but could add as an extra dataset)
  • MB report
  • Censor first value of MB report
  • NB report
  • NS report
  • NT dashboard
  • SK report
  • PE (multiple sources)
  • Canada-level time series and province-level yearly estimates from CIHI (excludes Quebec from April 2022 onward)
  • Add value to README
@jeanpaulrsoucy jeanpaulrsoucy added the data New data sources or updates to existing data sources. label Aug 13, 2023
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaDataProcess that referenced this issue Aug 16, 2023
- Add `hospitalizations_admissions` and `icu_admissions` (ccodwg/CovidTimelineCanada#111)
- Add `vaccine_administration_last_6_months` and `vaccine_coverage_last_6_months` (ccodwg/CovidTimelineCanada#91)
- Correct omission of `hospitalizations_cum` in a part of `process_dataset.R`
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaDataProcess that referenced this issue Sep 1, 2023
@jeanpaulrsoucy jeanpaulrsoucy added the P2 - Low priority Low priority updates label Sep 2, 2023
jeanpaulrsoucy added a commit that referenced this issue Sep 4, 2023
- Add experimental hosp_admissions and icu_admissions dataset (#111, #82).
- Currently, this dataset only supports data from MB.
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Sep 4, 2023
- So far, only MB data are included in the experimental hosp_admissions and icu_admissions dataset.
- ccodwg/CovidTimelineCanada#111
- ccodwg/CovidTimelineCanada#82
jeanpaulrsoucy added a commit that referenced this issue Sep 4, 2023
- Fix experimental icu_admissions dataset (#111, #82).
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Sep 23, 2023
- Update hospitalization/ICU data (ccodwg/CovidTimelineCanada#82)
- Remove covid19tracker.ca hosp/ICU data for NU, NT, YT (unreliable)
- Remove covid19tracker.ca hosp/ICU data for SK (captured in weekly report data)
- Update SK hosp/ICU data to use weekly report data (ccodwg/CovidTimelineCanada#64)
- Update YT with hosp admission time series (ccodwg/CovidTimelineCanada#111)
jeanpaulrsoucy added a commit that referenced this issue Sep 23, 2023
- Update hospitalization/ICU data (#82)
- Remove covid19tracker.ca hosp/ICU data for NU, NT, YT (unreliable)
- Remove covid19tracker.ca hosp/ICU data for SK (captured in weekly report data)
- Update SK hosp/ICU data to use weekly report data (#64)
- Update YT with hosp admission time series (#111)
@jeanpaulrsoucy
Copy link
Member Author

Note, for the hospital admission time series for YT, there are two datasets: the CSV (d720af0b-070a-4f67-ba5e-b1393757ba79) and the JSON (2fb9f970-04e0-4502-ae4a-67ec866dcad9). The CSV ends slightly earlier and contradicts the JSON slightly. However, it also places the date of the first hospitalization one day earlier, so I have added this correction but otherwise preferred the JSON dataset.

@jeanpaulrsoucy
Copy link
Member Author

A time series of admissions for NS can be extracted from ae74c46f-dec7-43d6-a42b-86c7242f0868.

An active_cumul strategy can be adopted for NL from 34f45670-34ed-415c-86a6-e14d77fcf6db.

@jeanpaulrsoucy
Copy link
Member Author

jeanpaulrsoucy commented Sep 26, 2023

A potential issue with admission data is that the full cumulative number may not be available, or only available beginning a certain date. Data notes will have to be included, at minimum. Will also have to edit datasets so that they have the correct daily values in the first row rather than the full cumulative value.

jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Oct 11, 2023
jeanpaulrsoucy added a commit that referenced this issue Oct 11, 2023
- Add hosp_admissions and icu_admissions for QC (#111, #104)
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaDataProcess that referenced this issue Oct 11, 2023
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaDataProcess that referenced this issue Oct 11, 2023
- Update processing for AB datasets (ccodwg/CovidTimelineCanada#116)
- Add support for ON admissions (ccodwg/CovidTimelineCanada#111)
- Add support for ON PT-level deaths (ccodwg/CovidTimelineCanada#120)
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Oct 11, 2023
- hosp_admissions and icu_admissions (ccodwg/CovidTimelineCanada#111)
- PT-level deaths time series for later use (ccodwg/CovidTimelineCanada#120)
jeanpaulrsoucy added a commit that referenced this issue Oct 11, 2023
- Add AB, ON hosp_admissions and icu_admissions (AB only) (#111)
- Add AB, ON PT-level deaths time series for later use (#120)
- Add old daily HR-level hosp_admissions dataset for ON (`raw_data/static/on/hosp_admissions_hr_ts.csv`) for posterity, but do not use over the current weekly dataset because the most recent weeks of data in the old time series are incomplete
@jeanpaulrsoucy
Copy link
Member Author

I added an old daily HR-level hosp_admissions dataset for ON (raw_data/static/on/hosp_admissions_hr_ts.csv) for posterity, but it should not be used over the current weekly dataset because the most recent weeks of data in the old time series are incomplete.

@jeanpaulrsoucy
Copy link
Member Author

jeanpaulrsoucy commented Oct 12, 2023

PEI starts tallying hosp/ICU admissions on their webpage on 2021-12-31 (68e5cbb9-0dcc-4a4f-ade0-58a0b06b1455) and ends with the final update of the original page on 2023-09-26. Data start to be split into years beginning with 2022-11-15.

jeanpaulrsoucy added a commit that referenced this issue Oct 13, 2023
- Include cumulative time series for cases, deaths, hosp_admissions, icu_admissions (#111, #118)
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Oct 13, 2023
- Update BC cases, deaths, hosp_admissions, icu_admissions to use cumulative time series from COVID-19 Situation Report (ccodwg/CovidTimelineCanada#118, ccodwg/CovidTimelineCanada#111)
- Update BC hospitalization, icu to use data from COVID-19 Situation Report (ccodwg/CovidTimelineCanada#82)
jeanpaulrsoucy added a commit that referenced this issue Oct 13, 2023
- Update BC cases, deaths, hosp_admissions, icu_admissions to use cumulative time series from COVID-19 Situation Report (#118, #111)
- Update BC hospitalization, icu to use data from COVID-19 Situation Report (#82)
@jeanpaulrsoucy
Copy link
Member Author

It should be possible to censor the value_daily for when cumulative time series of admissions do not begin from 0 (such as MB's).

@jeanpaulrsoucy
Copy link
Member Author

PE hosp/ICU admissions are reported on the old COVID-19 data page (68e5cbb9-0dcc-4a4f-ade0-58a0b06b1455) from 2021-12-31 to the page's retirement on 2023-09-26. On 2022-11-15, the page starts reporting hosp/ICU admissions by year, meaning the cumulative values for 2022 must be added to the cumulative values for 2021 (and later, 2023 + 2022 + 2021).

jeanpaulrsoucy pushed a commit that referenced this issue Oct 29, 2023
…111)

- MB raw data scraped from MB COVID-19 bulletins (news releases)
- NS hosp admissions from mostly recent value for each date from the archived time series of `ae74c46f-dec7-43d6-a42b-86c7242f0868`
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Oct 31, 2023
- Add final testing data for NB (ccodwg/CovidTimelineCanada#94)
- Update hosp admissions data for NS (ccodwg/CovidTimelineCanada#111)
jeanpaulrsoucy added a commit that referenced this issue Oct 31, 2023
- Add final testing data for NB (#94)
- Update hosp admissions data for NS (#111)
- Update metadata (#37)
@jeanpaulrsoucy
Copy link
Member Author

Hospital admissions are reported on the NT dashboard from 2021-08-25 to the end of the dashboard, 2022-06-13.

ICU admissions are reported on the NT dashboard from 2021-09-08 to the end of the dashboard, 2022-06-13. Prior to 2021-09-08, ICU admissions are simply reported as being "<5".

jeanpaulrsoucy added a commit that referenced this issue Oct 31, 2023
- Confirm NU has no admissions data
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Oct 31, 2023
- ccodwg/CovidTimelineCanada#111
- Since cumulative values are given but time series does not start at the beginning, the daily value is censored on the first date of data
- Update `write_dataset` to write blank NA values
jeanpaulrsoucy added a commit that referenced this issue Oct 31, 2023
- Since cumulative values are given but time series does not start at the beginning, the daily value is censored on the first date of data
@jeanpaulrsoucy
Copy link
Member Author

jeanpaulrsoucy commented Oct 31, 2023

Decided against including SK hosp admission data from the period of the first weekly report (#64) (i.e., during the period when hospital/ICU occupancy were reported) for several reasons:

  • ICU admissions are not reported, only hospital
  • Data are presented as an average daily value of the past 7 days, leading to rounding error
  • Data change significantly from when they are first reported ("current week") to when the are reported again in the subsequent week ("previous week"), with the following note: "Note: Because of the delay in date tested result, it affects the total number of COVID-19 admissions for a particular day. This lag in data impacts mostly the last couple of days from the day the report is updated." (By contrast, the hospital/ICU occupancy numbers do not change between reports)

Instead, I will begin using data starting with the monthly report.

@jeanpaulrsoucy
Copy link
Member Author

Should suppress first date of value_daily for MB hospital admissions/ICU admissions.

@jeanpaulrsoucy
Copy link
Member Author

See discussion of CCCS data for the Territories (#82 (comment)).

@jeanpaulrsoucy
Copy link
Member Author

The graphic in this news release suggests that hospital admissions probably include ICU admissions:

https://www.hss.gov.nt.ca/en/newsroom/public-service-announcement-%E2%80%93-updated-covid-19-statistics-march-15-2022

The metadata could probably be updated with this new information (#37).

jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Nov 2, 2023
- Add new NS report (ccodwg/CovidTimelineCanada#94)
- Add new PE report (ccodwg/CovidTimelineCanada#94)
- Add NS case, death, hosp admission data from new report (ccodwg/CovidTimelineCanada#111)
jeanpaulrsoucy added a commit that referenced this issue Nov 2, 2023
- Update NS, PE data
- Add new NS report (#94)
- Add new PE report (#94)
- Add NS case, death, hosp admission data from new report (#111)
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Nov 2, 2023
jeanpaulrsoucy added a commit that referenced this issue Dec 8, 2023
- PE hosp/ICU admissions data extraction by Kyla Belisario
- Previous PE hosp/ICU occupancy data extraction by Benjamin Wong

Co-authored-by: Kyla Belisario (she/her) <71769015+kbelisar@users.noreply.github.com>
Co-authored-by: Benjamin Wong <ben.kcwong@gmail.com>
jeanpaulrsoucy added a commit that referenced this issue Dec 8, 2023
- Add PE hosp/ICU admissions data (#111)
- Update data sources
jeanpaulrsoucy added a commit to ccodwg/Covid19CanadaETL that referenced this issue Dec 8, 2023
@jeanpaulrsoucy
Copy link
Member Author

There is an issue with PE hosp/ICU admissions around 2023-02-23 or 2023-02-24, where the cumulative value declines for a single day.

jeanpaulrsoucy added a commit that referenced this issue Apr 14, 2024
- Update ON HR-level deaths (#118) and hospital admissions (#118, #111) with latest data update from 2024-04-12 (for retroactive data updates, which are significant for the latest data, i.e., December 2023)
- Update ON data update script for cases, outcomes (#95)
jeanpaulrsoucy added a commit that referenced this issue Apr 14, 2024
- Update BC case, death, testing (#118) and hospital/ICU admission data (#111) with latest data update from 2024-04-11 (for retroactive data updates)
- Update BC data update script for cumulative data (#95)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data New data sources or updates to existing data sources. P2 - Low priority Low priority updates
Projects
None yet
Development

No branches or pull requests

1 participant