Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Convert excel files to csv files. Joe's modules #1508

Merged
merged 18 commits into from
Dec 17, 2024

Conversation

mnjowe
Copy link
Collaborator

@mnjowe mnjowe commented Nov 7, 2024

Converting all excel files to CSV files. Joe's modules

@mnjowe mnjowe self-assigned this Nov 7, 2024
@joehcollins
Copy link
Collaborator

@mnjowe - i've just deleted some of the old parameter files which are no longer needed and pushed the changes. (sorry didnt mean to use such an uninformative comit name).

Additionally- does this same process need to happen for pregnancy_supervisor.py?

@joehcollins
Copy link
Collaborator

@EvaJanouskova - have requested your review of this as the updates for the contraception parameter files are also in this branch.

@mnjowe
Copy link
Collaborator Author

mnjowe commented Nov 8, 2024

@mnjowe - i've just deleted some of the old parameter files which are no longer needed and pushed the changes. (sorry didnt mean to use such an uninformative comit name).

Additionally- does this same process need to happen for pregnancy_supervisor.py?

Absolutely right Joe. That Excel file needs to be converted using same method. Can you also remind me any of your modules you feel are using excel files but not included in this PR?

…v_Joe_modules' into mnjowe/convert_excel_files_to_csv_Joe_modules
Copy link
Collaborator

@joehcollins joehcollins left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great thanks @mnjowe - this looks all good to me!

@EvaJanouskova
Copy link
Collaborator

@timcolbourn, I wonder, if we won't loose some useful information this way. Because in csv files you don't see where the numbers are coming from, shouldn't the csv files also contain the information on what is the origin of the numbers?

For example, values in the column r_init1_age (B2-B36) in the Initiation_ByAge.csv is based on the proportion relative change compared to average values (E8-E42) from DELETE_Initiation1_by_age.csv. Should be such information stored in the Initiation_ByAge.csv, or?

If so, I would also suggest to update the names of the files with calculations to smt like CALC_ instead of DELETE_.

@EvaJanouskova
Copy link
Collaborator

@timcolbourn, I wonder, if we won't loose some useful information this way. Because in csv files you don't see where the numbers are coming from, shouldn't the csv files also contain the information on what is the origin of the numbers?

For example, values in the column r_init1_age (B2-B36) in the Initiation_ByAge.csv is based on the proportion relative change compared to average values (E8-E42) from DELETE_Initiation1_by_age.csv. Should be such information stored in the Initiation_ByAge.csv, or?

If so, I would also suggest to update the names of the files with calculations to smt like CALC_ instead of DELETE_.

@timcolbourn, I went through all the CSVs (converted from the ResourceFile_Contraception sheets) and beside the sheets starting with DELETE_, or DEL_, we also don't use the contraception_failure_discont sheet. All these CSVs can be deleted. And if you like to have backup of the calculations of the data included in the CSVs we are using, the original spreadsheet could be saved on OneDrive, and that's it. What do you think?

@mnjowe, Are you happy to do all of that (delete the CSVs, and save the original ResourceFile_Contraception spreadsheet on OneDrive)? Or do you need me to do any of that?

@tamuri
Copy link
Collaborator

tamuri commented Dec 13, 2024

@mnjowe - please action Eva's comments.

Once that's done, please request review from @EvaJanouskova to approve before this can be merged.

@mnjowe
Copy link
Collaborator Author

mnjowe commented Dec 16, 2024

That's well noted @tamuri . @EvaJanouskova, much thanks for taking your time looking at the CSV files. I will try deleting the files as suggested and let you take another look. Thanks

@mnjowe
Copy link
Collaborator Author

mnjowe commented Dec 16, 2024

original contraception excel file moved to sharepoint here

Copy link
Collaborator

@EvaJanouskova EvaJanouskova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems good to me @mnjowe. Thanks!

@tamuri tamuri merged commit 63a06d8 into master Dec 17, 2024
62 checks passed
@tamuri tamuri deleted the mnjowe/convert_excel_files_to_csv_Joe_modules branch December 17, 2024 21:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants