Clinical efficacy score

[Yingshu-Li]

Hi,

I used your trained mimic-cxr weight to infer the test set. I get almost the same result as the NLP score. But, I also followed your instructions to use Chexpert and Chexbert to label the report and calculate the CE score using your script. I tried the two label methods you gave me but I can't reproduce your result.

Here is my result.
{'F1_MACRO': 0.21054676943711254,
'F1_MICRO': 0.37574679039023773,
'RECALL_MACRO': 0.3051327263640022,
'RECALL_MICRO': 0.4828487422410977,
'PRECISION_MACRO': 0.19370866272550938,
'PRECISION_MICRO': 0.3075322513524761}

[Justarrrrr]

hi, i want to get the ce metrics, can you share your code for using Chexpert and Chexbert to label the report?