Skip to content
This repository has been archived by the owner on May 16, 2023. It is now read-only.

Date of last high risk contact wrong #818

Closed
masema67 opened this issue Jan 23, 2022 · 21 comments
Closed

Date of last high risk contact wrong #818

masema67 opened this issue Jan 23, 2022 · 21 comments
Assignees
Labels
bug Something isn't working mirrored-to-jira This item is also tracked internally in JIRA

Comments

@masema67
Copy link

masema67 commented Jan 23, 2022

Avoid duplicates

  • [X ] Bug is not mentioned in the FAQ

Technical details

Device name: Google Pixel 4a 5G
iOS/Android version: Android 12
App version: 2.16.2

Describe the bug

positive rapid test and positive PCR test conducted and registered in CWA at the 20.01.2022

People with very close contact to this person for hours and every day receive high risks warnings for the 14.01 to 18.01 but not for the 19.01 and 20.01 even so in very close contact to the person for hours at those dates.

Update: date of symptom onset was entered as 14.01 when CWA requested

Steps to reproduce the issue

see above

Expected behaviour

last contact should be displayed for the 20.01 and not 18.01

Possible Fix

Additional context


Internal Tracking ID: EXPOSUREAPP-11569

@masema67 masema67 added the bug Something isn't working label Jan 23, 2022
@Ein-Tim
Copy link
Contributor

Ein-Tim commented Jan 23, 2022

The dates come directly from the underlying OS framework.

Seems like on days 18.01-20.01 CWA sees no contacts "above" the threshold.

More information: https://www.coronawarn.app/en/faq/#encounter_19_calc

@MikeMcC399
Copy link
Contributor

@masema67

There is no complete up-to-date description of the risk calculation process. You might like to refer though to https://github.com/corona-warn-app/cwa-documentation/blob/master/cwa-risk-assessment.md which shows how the transmission risk level decreases over time. The app also takes account if / when symptoms were reported. The collection of FAQ articles under https://www.coronawarn.app/en/faq/#risk_assessment also discusses some aspects.

So what you describe could be correct. It is impossible to check for an individual case though because access to the data used in the calculations is restricted, due to privacy protections.

@masema67
Copy link
Author

The dates come directly from the underlying OS framework.

Seems like on days 18.01-20.01 CWA sees no contacts "above" the threshold.

More information: https://www.coronawarn.app/en/faq/#encounter_19_calc

""above" the threshold" is for sure not possible, as contacts where for hours with partly no distance between the phones for quite some time

@masema67
Copy link
Author

masema67 commented Jan 23, 2022

@masema67

There is no complete up-to-date description of the risk calculation process. You might like to refer though to https://github.com/corona-warn-app/cwa-documentation/blob/master/cwa-risk-assessment.md which shows how the transmission risk level decreases over time. The app also takes account if / when symptoms were reported. The collection of FAQ articles under https://www.coronawarn.app/en/faq/#risk_assessment also discusses some aspects.

So what you describe could be correct. It is impossible to check for an individual case though because access to the data used in the calculations is restricted, due to privacy protections.

Thank you! The same behavior is observed with CCTG with microG implementation- so it is not google but for sure a not sense making behavior by CWA.

@dsarkar
Copy link
Member

dsarkar commented Jan 25, 2022

Dear @masema67,

Thank you very much for this report. We have been discussing this case internally, and yes, the indications, although surprising, could be correct as you describe it. However, we would be very interested to talk to you, in order to get a more detailed insight about this specific case.

A developer/architect from the team would talk to you, ideally by telephone. Please, contact us via email (corona-warn-app.opensource@sap.com), in order to arrange details. Please mention in the email the Internal Tracking ID: EXPOSUREAPP-11569

Best wishes, DS


Corona-Warn-App Open Source Team

@dsarkar dsarkar added the mirrored-to-jira This item is also tracked internally in JIRA label Jan 25, 2022
@mlenkeit
Copy link
Member

There is no complete up-to-date description of the risk calculation process.

@MikeMcC399 what about https://github.com/corona-warn-app/cwa-documentation/blob/master/solution_architecture.md#risk-calculation?

@MikeMcC399
Copy link
Contributor

MikeMcC399 commented Jan 25, 2022

@mlenkeit

There is no complete up-to-date description of the risk calculation process.

what about https://github.com/corona-warn-app/cwa-documentation/blob/master/solution_architecture.md#risk-calculation?

Thanks for reminding us about the section in the Solution Architecture document. This at least contains the description of how Onset of Symptoms is used.

Could you please check about the Figure 16: Risk calculation
https://github.com/corona-warn-app/cwa-documentation/blob/master/images/solution_architecture/risk_calculation.svg

which has a threshold of 13 minutes (where I would expect this to show 9 minutes).

According to https://www.coronawarn.app/en/blog/2021-04-16-corona-warn-app-risk-calculation-further-improved/ dated April 16, 2021 the risk calculation was changed last year:

"For app users, this means: Previously, an encounter between two people had to last at least 13 minutes in order to be considered for an encounter with an increased risk (red tile). Now, the app considers encounters of at least 9 minutes. Thus, encounters that represent an actual relevant contact with COVID-19 infected persons can be detected even more accurately and represented accordingly in the app as a warning about an encounter with increased risk"

So the diagram and the blog information are contradictory.

@MikeMcC399
Copy link
Contributor

MikeMcC399 commented Jan 25, 2022

@mlenkeit

I took a closer look at the diagram https://github.com/corona-warn-app/cwa-documentation/blob/master/images/solution_architecture/risk_calculation.svg

On the left-hand side it is still using 13 minutes and on the right-hand side it uses 9 minutes. (See new #586 (comment).)

mlenkeit added a commit that referenced this issue Jan 25, 2022
consistently use 5 and 9 minutes as thresholds throughout the diagram.
additionally, re-generates the pdf for the svg

related to #586, #453, #818
@masema67
Copy link
Author

masema67 commented Jan 25, 2022

Dear @masema67,

Thank you very much for this report. We have been discussing this case internally, and yes, the indications, although surprising, could be correct as you describe it. However, we would be very interested to talk to you, in order to get a more detailed insight about this specific case.

A developer/architect from the team would talk to you, ideally by telephone. Please, contact us via email (corona-warn-app.opensource@sap.com), in order to arrange details. Please mention in the email the Internal Tracking ID: EXPOSUREAPP-11569

Best wishes, DS

Corona-Warn-App Open Source Team

I sent them an email and will be glad to give more details on the phone.
best
masema67

@dsarkar
Copy link
Member

dsarkar commented Jan 26, 2022

@masema67 Ok! Thanks!

Best wishes, DS


Corona-Warn-App Open Source Team

@MikeMcC399
Copy link
Contributor

The risk calculation diagram images/solution_architecture/risk_calculation.svg has now been corrected.

@thomasaugsten
Copy link
Member

Thanks for updating the date of symptoms onset. Only 4 days after the onset leads to TRL > 2 which shows a warning to other persons
image

@MikeMcC399
Copy link
Contributor

MikeMcC399 commented Jan 26, 2022

@thomasaugsten
Thanks for the post with the diagram. This is from the presentation https://www.coronawarn.app/assets/documents/cwa-rc3.pdf from @tklingbeil in Dec 2020 (see https://www.coronawarn.app/en/blog/2020-12-30-cwa-behind-the-scenes/ for anybody who would like to view the video as well).


I see that @masema67 updated the information. Onset of symptoms Jan 14, 2022 together with test date Jan 20, 2022. By my calculation, onset of symptoms is 6 days before submission.

Using the table from the presentation on page 15, with the row 6 "Days since the onset of symptoms (at the point of submission)", Day 1 (Jan 19) and Day 0 (Jan 20) are both shown with roman numeral "II" Transmission Risk Level (TRL).

The updated diagram of risk calculation on images/solution_architecture/risk_calculation.svg shows TRL of "II" being weighted with a factor 0.0. This means that exposures on the days Jan 19 and Jan 20 are not calculated as a red risk result and therefore the behavior, which @masema67 reported as an issue, seems to be correct.

Maybe @thomasaugsten could confirm that the above is correct?

@mlenkeit
Copy link
Member

@MikeMcC399 yes, that's correct. The 19th and 20th both translate to TRL <= II, and thus, do not count as exposures and are rightly not considered for the date of the last exposure.

@MikeMcC399
Copy link
Contributor

@masema67

It seems that we have a good explanation for what you saw. If you agree that your issue has been addressed, you could close the issue here.

@mlenkeit mlenkeit assigned mlenkeit and unassigned maugst Jan 28, 2022
@ndegendogo
Copy link

@mlenkeit I assume / hope you are in close feedback loop with RKI if the "risk profile" is still considered good from today's point of view?
Iirc it was published in Dec 2020 (but maybe the numbers were updated since then?)
Since then we had Alpha, Delta, and now Omikron.

@MikeMcC399
Copy link
Contributor

@ndegendogo
There was a blog post on this subject a couple of weeks ago. See Wird die CWA an die Omikron-Variante angepasst?. That wasn't really the subject of this issue however.

@mlenkeit
Copy link
Member

mlenkeit commented Feb 4, 2022

@ndegendogo the blog post that @MikeMcC399 referenced (thx!) sums it up pretty well 😊

@MikeMcC399
Copy link
Contributor

Is there anything further which can be done on this issue?

@Ein-Tim
Copy link
Contributor

Ein-Tim commented Apr 19, 2022

@dsarkar Please apply the ready-to-close label here.

@larswmh
Copy link
Member

larswmh commented Jun 15, 2022

Closing as suggested.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working mirrored-to-jira This item is also tracked internally in JIRA
Projects
None yet
Development

No branches or pull requests

9 participants