Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write NaN into HDF5 instead of None for metadata #82

Merged
merged 131 commits into from
Jan 6, 2023
Merged
Changes from all commits
Commits
Show all changes
131 commits
Select commit Hold shift + click to select a range
3d7c5bb
Mod on Dockerfile for cslc_s1 point release and few improvement
Jul 28, 2022
541721c
Merge pull request #6 from opera-adt/main
seongsujeong Jul 28, 2022
86724cd
Merge branch 'main' of github.com:opera-adt/COMPASS into docker
Aug 29, 2022
a5d1961
Docker image size optimized
Aug 30, 2022
1cbcd5d
Removing the commands in the header comment
Aug 30, 2022
04f8427
Initial commit after branch-out
seongsujeong Nov 21, 2022
4cada71
minor fix; metadata writeout
seongsujeong Nov 21, 2022
87b48a8
Merge remote-tracking branch 'opera-adt/main' into eap_correction_int…
seongsujeong Nov 21, 2022
1ffa745
Update src/compass/utils/elevation_antenna_pattern.py
seongsujeong Nov 23, 2022
c2d5e28
Update src/compass/utils/elevation_antenna_pattern.py
seongsujeong Nov 23, 2022
8430c07
Comments on PR addressed; docstring for `apply_eap_correction` fixed
seongsujeong Nov 23, 2022
4521971
comment clarification
seongsujeong Nov 23, 2022
b776b52
comment clarification
seongsujeong Nov 23, 2022
bb0c21e
addressing codacy issues
seongsujeong Nov 23, 2022
832d415
Applying EAP correction (or skip) before `range_split_spectrum`
seongsujeong Nov 28, 2022
a5c2a7e
addressing codacy issue
seongsujeong Nov 28, 2022
f04762b
metadata field name changed
seongsujeong Nov 30, 2022
05cc56a
Update src/compass/s1_geocode_slc.py
seongsujeong Nov 30, 2022
0405bb9
Update src/compass/s1_geocode_slc.py
seongsujeong Nov 30, 2022
4f59383
Update src/compass/s1_geocode_slc.py
seongsujeong Nov 30, 2022
ecafe57
Update src/compass/s1_geocode_slc.py
seongsujeong Nov 30, 2022
05c9af8
Merge branch 'eap_correction_into_s1_geocode_slc' of github.com:seong…
seongsujeong Nov 30, 2022
431f432
converting burst ID to `str`
seongsujeong Dec 2, 2022
228d936
using EPSG from geogrid, not from input DEM
seongsujeong Dec 2, 2022
d2d5971
Merge branch 'eap_correction_into_s1_geocode_slc'
seongsujeong Dec 6, 2022
42f1a1c
Revert "Merge branch 'eap_correction_into_s1_geocode_slc'"
seongsujeong Dec 6, 2022
76121c5
adding azimuth FM rate mismatch into lut.py
seongsujeong Dec 6, 2022
2640cce
docstring fixed; variable name changed
seongsujeong Dec 7, 2022
d8060ae
docstring for file added; raise error when DEM is not valid
seongsujeong Dec 7, 2022
cbff3c2
Update src/compass/utils/lut.py
seongsujeong Dec 7, 2022
8b457a8
Update src/compass/utils/lut.py
seongsujeong Dec 8, 2022
244f381
updates on local
seongsujeong Dec 8, 2022
c05a524
Merge branch 'az_fm_rate_mismatch' of github.com:seongsujeong/COMPASS…
seongsujeong Dec 8, 2022
f024f9e
returning az_lut as `isce3.core.LUT2d()` code based on the suggestion…
seongsujeong Dec 8, 2022
7fe5b2b
docstring revised
seongsujeong Dec 8, 2022
e61bda8
removing redundant renaming of the variables
seongsujeong Dec 8, 2022
049fb3d
Merge branch 'main' into docker
Dec 10, 2022
f54be6f
Dockerfile for beta release
Dec 13, 2022
f7e8770
Specfile updated
Dec 13, 2022
1e15cd0
specifile updated
Dec 13, 2022
779b5e9
tag on beta.Dockerfile updated
Dec 13, 2022
afaa550
specifile updated
Dec 13, 2022
61238e0
typo fix
Dec 13, 2022
fa98a10
beta.Dockerfile updated
Dec 13, 2022
6fc5fe8
updates on `s1_geocode_slc.py`
Dec 13, 2022
6812072
but fix
seongsujeong Dec 13, 2022
c6851a6
updates on beta.Dockerfile
Dec 13, 2022
fe59186
Dockerfile renamed
Dec 13, 2022
eb1f38d
Merge branch 'main' of github.com:opera-adt/COMPASS into docker
Dec 13, 2022
3ed0702
untested writing az/rg correction LUT to hdf5
LiangJYu Dec 14, 2022
a085de6
restructed HDF5
LiangJYu Dec 16, 2022
a66b1eb
fix doppler return type
LiangJYu Dec 16, 2022
95c9bd2
fix paths
LiangJYu Dec 17, 2022
4426165
fix correction group organization
LiangJYu Dec 17, 2022
be32714
Merge remote-tracking branch 'origin/az_fm_rate_mismatch'
seongsujeong Dec 18, 2022
0d80c8a
camel to snake
LiangJYu Dec 19, 2022
c9e0230
Merge branch 'main' of github.com:seongsujeong/COMPASS
Dec 19, 2022
d36cc5c
restore s1_burst_metadata
LiangJYu Dec 19, 2022
757a082
PEP8 and syntax fixes
LiangJYu Dec 19, 2022
7f72867
fix correction grouping
LiangJYu Dec 19, 2022
b011876
specfile updated
Dec 19, 2022
422a9b2
Specfile updated
Dec 19, 2022
5c748ff
Merge branch 'docker'
Dec 19, 2022
c04bf6c
Merge branch 'main' of github.com:seongsujeong/COMPASS
Dec 19, 2022
8cbbddd
s1-reader version updated
seongsujeong Dec 19, 2022
6247061
Merge branch 'main' into docker
Dec 19, 2022
d2f011b
Added `0.2` into `version.Tag`
Dec 19, 2022
bb3bf2a
remove radar grid usage from geo grid
LiangJYu Dec 19, 2022
081b575
Merge branch 'main' of github.com:opera-adt/COMPASS into az_fm_rate_m…
Dec 19, 2022
1c6424f
fix CSLC raster validation
LiangJYu Dec 20, 2022
d1168f5
Merge branch 'corrections2hdf5' of github.com:LiangJYu/COMPASS into a…
Dec 20, 2022
98eacea
fix typo
yunjunz Dec 20, 2022
0f908ea
Update src/compass/utils/lut.py
seongsujeong Dec 20, 2022
4830e89
Update src/compass/utils/lut.py
seongsujeong Dec 20, 2022
d75bf39
docstring revised
Dec 20, 2022
dd6c66f
Merge branch 'az_fm_rate_mismatch' of github.com:seongsujeong/COMPASS…
Dec 20, 2022
a5138d0
ref -> reference w/r/t _epoch
LiangJYu Dec 20, 2022
989b4b1
fix burst border
LiangJYu Dec 20, 2022
047ef11
Separate bistatic and azimuth FM rate
Dec 20, 2022
65f924b
change function return unpacking
Dec 20, 2022
ccfbfec
add all parameters needed to reconstruct burst object
LiangJYu Dec 20, 2022
db67356
wrap value assignment with try+except
LiangJYu Dec 20, 2022
fdd16fa
burst DB now static
LiangJYu Dec 20, 2022
30912cc
fix burst.center type
LiangJYu Dec 20, 2022
1d06dec
fix writing empty burst polynomials
LiangJYu Dec 20, 2022
bcb3269
fix misformed poly1d items
LiangJYu Dec 20, 2022
ff86e88
rename geocoding interpolator item
LiangJYu Dec 20, 2022
6b745ec
move runconfig
LiangJYu Dec 20, 2022
86b9308
Update src/compass/utils/h5_helpers.py
LiangJYu Dec 20, 2022
5e2352d
Update src/compass/utils/h5_helpers.py
LiangJYu Dec 20, 2022
173f534
Update src/compass/utils/h5_helpers.py
LiangJYu Dec 20, 2022
6aa590f
Update src/compass/utils/h5_helpers.py
LiangJYu Dec 20, 2022
fd6adaa
Update src/compass/utils/h5_helpers.py
LiangJYu Dec 20, 2022
aa22f2c
fix product name
LiangJYu Dec 20, 2022
c8851ef
add az fm rate mismatch into `h5_helpers.py`
Dec 20, 2022
feabce5
reverting s1_geocode_slc.py
Dec 20, 2022
165c9d0
reverting `lut.py`
Dec 20, 2022
8daec8e
Update src/compass/utils/h5_helpers.py
LiangJYu Dec 20, 2022
6661bc7
Update src/compass/utils/h5_helpers.py
LiangJYu Dec 20, 2022
42d3545
Update src/compass/utils/h5_helpers.py
LiangJYu Dec 20, 2022
6b7b712
Update src/compass/utils/h5_helpers.py
LiangJYu Dec 20, 2022
f41b2f8
Update src/compass/utils/h5_helpers.py
LiangJYu Dec 20, 2022
35b8ddd
spelling error
LiangJYu Dec 20, 2022
98af422
Merge branch 'corrections2hdf5' of github.com:LiangJYu/COMPASS into c…
LiangJYu Dec 20, 2022
9fb51a7
fix descriptions
LiangJYu Dec 21, 2022
0e2ae4c
Version number changed
Dec 21, 2022
ffb4aba
add `validate_cslc.py` to `setup.cfg`
Dec 21, 2022
e79d4fa
Flexibility on Docker's entrypoint to run the validation script
Dec 21, 2022
383635d
Merge branch 'az_fm_rate_mismatch'
Dec 21, 2022
b98e0d8
Merge branch 'corrections2hdf5' of github.com:LiangJYu/COMPASS into a…
Dec 21, 2022
e1c73f1
PEP8
Dec 21, 2022
6b219a4
Merge branch 'az_fm_rate_mismatch'
Dec 21, 2022
892d30e
add entrypoint to `validate_cslc.py`
Dec 21, 2022
6f276f2
fix on `setup.cfg`
Dec 21, 2022
58812e8
Merge branch 'docker'
Dec 21, 2022
388f34f
Update src/compass/utils/validate_cslc.py
seongsujeong Dec 21, 2022
a1c381b
Merge branch 'main' into docker
seongsujeong Dec 21, 2022
36f9aef
Change version for s1-reader
Dec 21, 2022
15df168
Merge branch 'docker' of github.com:seongsujeong/COMPASS into docker
Dec 21, 2022
04cd768
Removing default value for `dem_path`
Dec 21, 2022
99b78a9
Update src/compass/utils/lut.py
seongsujeong Dec 21, 2022
922e32e
Merge branch 'main' into az_fm_rate_mismatch
seongsujeong Dec 21, 2022
371a5a3
Merge branch 'az_fm_rate_mismatch'
Dec 21, 2022
1f723b2
Merge branch 'docker'
Dec 21, 2022
eea804b
release date updated for `0.1.3`
Dec 21, 2022
cfc8b46
Change base Docker image into Oracle Linux
Dec 21, 2022
046f41e
Merge branch 'docker'
Dec 21, 2022
69ae43e
typo fix
Dec 21, 2022
5cf082d
Merge branch 'docker'
Dec 21, 2022
9dd85be
Merge branch 'main' of github.com:opera-adt/COMPASS
Jan 5, 2023
163ca9c
write NaN instead of None
Jan 5, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 8 additions & 5 deletions src/compass/utils/h5_helpers.py
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,10 @@ def add_dataset_and_attrs(group, meta_item):
# Convert data to written if necessary
val = _as_np_string_if_needed(meta_item.value)
try:
group[meta_item.name] = val
if val is None:
group[meta_item.name] = np.nan
else:
group[meta_item.name] = val
except TypeError:
raise TypeError(f'unable to write {meta_item.name}')

Expand Down Expand Up @@ -680,13 +683,13 @@ def corrections_to_h5group(parent_group, burst, cfg):
Meta('range_pixel', noise.range_pixel, 'Range array in pixel for LUT'),
Meta('range_lut', noise.range_lut, 'Range noise lookup table data'),
Meta('azimuth_first_azimuth_line', noise.azimuth_first_azimuth_line,
'First line of the burst in subswath. None if not available in annotation.'),
'First line of the burst in subswath. NaN if not available in annotation.'),
Meta('azimuth_first_range_sample', noise.azimuth_first_range_sample,
'First range sample of the burst. None if not available in annotation.'),
'First range sample of the burst. NaN if not available in annotation.'),
Meta('azimuth_last_azimuth_line', noise.azimuth_last_azimuth_line,
'Last line of the burst in subswatn. None if not available in annotation.'),
'Last line of the burst in subswatn. NaN if not available in annotation.'),
Meta('azimuth_last_range_sample', noise.azimuth_last_range_sample,
'Last range of the burst. None if not available in annotation.'),
'Last range of the burst. NaN if not available in annotation.'),
Meta('azimuth_line', noise.azimuth_line, 'azimuth line index for noise LUT'),
Meta('azimuth_lut', noise.azimuth_lut, 'azimuth noise lookup table data')
]
Expand Down