Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RFI reader and miscellaneous metadata reader for CARD-NRB compliance #97

Merged
merged 166 commits into from
May 10, 2023

Conversation

seongsujeong
Copy link
Contributor

@seongsujeong seongsujeong commented Jan 25, 2023

This PR adds s1-reader an ability to load Radio Frequency Interferences (RFI) information, which is available starting from IPF version 3.40.

edit: 03/31/2023
This PR also includes the feature add to load miscellaneous metadata to populate the metadata of RTC-S1 to comply with CEOS Analysis Ready Data - Normalized Radar Backscatter (CARD-NRB)

seongsujeong and others added 30 commits August 8, 2022 11:51
Updating the main branch of this fork to update after `s1_annotation.py`
…r implementation for thermal and EAP correction
Readability improvement on equation

Co-authored-by: Liang Yu <liangjyu@gmail.com>
Removing commented out code

Co-authored-by: Liang Yu <liangjyu@gmail.com>
Reverting the docstring to be split into two lines for PEP8 compliance

Co-authored-by: Liang Yu <liangjyu@gmail.com>
Improving docstring of the code copied from isce2

Co-authored-by: Liang Yu <liangjyu@gmail.com>
Removing the commented out codes

Co-authored-by: Liang Yu <liangjyu@gmail.com>
improvement on code brevity

Co-authored-by: Liang Yu <liangjyu@gmail.com>
renaming variable for better clarity

Co-authored-by: Liang Yu <liangjyu@gmail.com>
renaming variable name for clarity

Co-authored-by: Liang Yu <liangjyu@gmail.com>
Bump isce3 to 0.8 and refresh CI specfile (isce-framework#66)
variable name revised for clarity

Co-authored-by: Liang Yu <liangjyu@gmail.com>
variable renamed for clarity

Co-authored-by: Liang Yu <liangjyu@gmail.com>
improvement on docstring

Co-authored-by: Liang Yu <liangjyu@gmail.com>
Readability improvement of equation

Co-authored-by: Liang Yu <liangjyu@gmail.com>
@seongsujeong
Copy link
Contributor Author

@gshiroma @vbrancat This PR will be used to extract RFI information to be populated in the RTC and CSLC product.
Would you mind taking a look at this PR? Thanks

@seongsujeong seongsujeong changed the title RFI reader RFI reader and miscellaneous metadata reader for CARD4L-NRB compliance Mar 31, 2023
@seongsujeong seongsujeong changed the title RFI reader and miscellaneous metadata reader for CARD4L-NRB compliance RFI reader and miscellaneous metadata reader for CARD-NRB compliance Mar 31, 2023
Copy link
Contributor

@gshiroma gshiroma left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you so much for this updates, @seongsujeong . We talked offline, but I'll leave some of the comments we talked about here for reference.

src/s1reader/s1_annotation.py Outdated Show resolved Hide resolved
src/s1reader/s1_annotation.py Outdated Show resolved Hide resolved
src/s1reader/s1_reader.py Outdated Show resolved Hide resolved
src/s1reader/s1_reader.py Show resolved Hide resolved
src/s1reader/s1_annotation.py Show resolved Hide resolved
src/s1reader/s1_annotation.py Show resolved Hide resolved
Copy link
Contributor

@vbrancat vbrancat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @seongsujeong I only have minor comments on the code. Hopefully I can find some time to test the code.

src/s1reader/s1_annotation.py Show resolved Hide resolved
"numSubBlocks": int,
"subBlockSize": int,
"maxPercentageAffectedBW": float,
"percentageBlocksPersistentRfi": float,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
"percentageBlocksPersistentRfi": float,
"percentageBlocksPersistentRFI": float,

For consistency with Gustavo's comment.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The keys in dict_datatype_rfi have to be in exact match with the field names in RFI annotation .xml files because the following function element_to_dict() make use of the dictionary to parse the XML.

src/s1reader/s1_reader.py Outdated Show resolved Hide resolved
@vbrancat
Copy link
Contributor

@seongsujeong, any progress on this PR?

@seongsujeong
Copy link
Contributor Author

@vbrancat @gshiroma Would you mind taking another look at the PR? Thanks!

Copy link
Contributor

@gshiroma gshiroma left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great, @seongsujeong . I have just a few minor comments below. I think we are close to merge it. Thanks!

src/s1reader/s1_annotation.py Outdated Show resolved Hide resolved
src/s1reader/s1_annotation.py Outdated Show resolved Hide resolved
src/s1reader/s1_annotation.py Show resolved Hide resolved
src/s1reader/s1_reader.py Outdated Show resolved Hide resolved
src/s1reader/s1_reader.py Outdated Show resolved Hide resolved
Co-authored-by: Gustavo H. X. Shiroma <52007211+gshiroma@users.noreply.github.com>
Copy link
Contributor

@vbrancat vbrancat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM :)

@seongsujeong seongsujeong merged commit 3065cc8 into isce-framework:main May 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants