Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge back 1.2.0rc2 #942

Merged
merged 11 commits into from
Apr 17, 2023
Merged

Merge back 1.2.0rc2 #942

merged 11 commits into from
Apr 17, 2023

Conversation

vinnamkim
Copy link
Contributor

Summary

  • Merge back 1.2.0rc2 to develop

How to test

Checklist

  • I have added unit tests to cover my changes.​
  • I have added integration tests to cover my changes.​
  • I have added the description of my changes into CHANGELOG.​
  • I have updated the documentation accordingly

License

  • I submit my code changes under the same MIT License that covers the project.
    Feel free to contact the maintainers if that's a concern.
  • I have updated the license header for each file (see an example below).
# Copyright (C) 2023 Intel Corporation
#
# SPDX-License-Identifier: MIT

vinnamkim and others added 10 commits April 14, 2023 19:05
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
<!-- Contributing guide:
https://github.com/openvinotoolkit/datumaro/blob/develop/CONTRIBUTING.md
-->

### Summary
Disentangle temporary directory management

- Fixed to remove and move manually each files instead of whole
directory itself.

<!--
Resolves #111 and #222.
Depends on #1000 (for series of dependent commits).

This PR introduces this capability to make the project better in this
and that.

- Added this feature
- Removed that feature
- Fixed the problem #1234
-->

### How to test
<!-- Describe the testing procedure for reviewers, if changes are
not fully covered by unit tests or manual testing can be complicated.
-->

### Checklist
<!-- Put an 'x' in all the boxes that apply -->
- [ ] I have added unit tests to cover my changes.​
- [ ] I have added integration tests to cover my changes.​
- [ ] I have added the description of my changes into
[CHANGELOG](https://github.com/openvinotoolkit/datumaro/blob/develop/CHANGELOG.md).​
- [ ] I have updated the
[documentation](https://github.com/openvinotoolkit/datumaro/tree/develop/docs)
accordingly

### License

- [ ] I submit _my code changes_ under the same [MIT
License](https://github.com/openvinotoolkit/datumaro/blob/develop/LICENSE)
that covers the project.
  Feel free to contact the maintainers if that's a concern.
- [ ] I have updated the license header for each file (see an example
below).

```python
# Copyright (C) 2023 Intel Corporation
#
# SPDX-License-Identifier: MIT
```

Signed-off-by: Inhyuk Andy Cho <andy.inhyuk.jo@intel.com>
- Ticket no. 107275
- Resolved circular dependency on merge codes: introduce `IMerger` and
move `DatasetItemStorage` and `DatasetItemStorageDatasetView` from
`dataset.py` to `dataset_item_storage.py`.
- Corrected function typing for all `Merger`s.
- Refactor `HLOps.merge()` and use it in
`datumaro/cli/commands/merge.py` as well.

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
- Ticket no. 107273
- Update merge tutorial (Jupyter notebook) for real life usecase

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
…933)

<!-- Contributing guide:
https://github.com/openvinotoolkit/datumaro/blob/develop/CONTRIBUTING.md
-->

### Summary

<!--
Resolves #111 and #222.
Depends on #1000 (for series of dependent commits).

This PR introduces this capability to make the project better in this
and that.

- Added this feature
- Removed that feature
- Fixed the problem #1234
-->

### How to test
<!-- Describe the testing procedure for reviewers, if changes are
not fully covered by unit tests or manual testing can be complicated.
-->

### Checklist
<!-- Put an 'x' in all the boxes that apply -->
- [ ] I have added unit tests to cover my changes.​
- [ ] I have added integration tests to cover my changes.​
- [ ] I have added the description of my changes into
[CHANGELOG](https://github.com/openvinotoolkit/datumaro/blob/develop/CHANGELOG.md).​
- [ ] I have updated the
[documentation](https://github.com/openvinotoolkit/datumaro/tree/develop/docs)
accordingly

### License

- [ ] I submit _my code changes_ under the same [MIT
License](https://github.com/openvinotoolkit/datumaro/blob/develop/LICENSE)
that covers the project.
  Feel free to contact the maintainers if that's a concern.
- [ ] I have updated the license header for each file (see an example
below).

```python
# Copyright (C) 2023 Intel Corporation
#
# SPDX-License-Identifier: MIT
```

---------

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Co-authored-by: Vinnam Kim <vinnam.kim@intel.com>
 - Ticket no. 107274
 - Add `merge_policy` to the merge CLI command
 - Give a clear role for each merge policy
- Now, `UnionMerge` tries to include all overlapping `(id,subset)` pairs
by appending `-{idx}` suffix to their `id`s and this is the clear
difference with `IntersectMerge`.
 -Updated docstrings to help users understand our merge policies.

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
<!-- Contributing guide:
https://github.com/openvinotoolkit/datumaro/blob/develop/CONTRIBUTING.md
-->

### Summary

* Added docs workflow for stable release
* Updated some docstrings
* Fixed some docs build errors

<!--
Resolves #111 and #222.
Depends on #1000 (for series of dependent commits).

This PR introduces this capability to make the project better in this
and that.

- Added this feature
- Removed that feature
- Fixed the problem #1234
-->

### How to test
<!-- Describe the testing procedure for reviewers, if changes are
not fully covered by unit tests or manual testing can be complicated.
-->

### Checklist
<!-- Put an 'x' in all the boxes that apply -->
- [ ] I have added unit tests to cover my changes.​
- [ ] I have added integration tests to cover my changes.​
- [ ] I have added the description of my changes into
[CHANGELOG](https://github.com/openvinotoolkit/datumaro/blob/develop/CHANGELOG.md).​
- [ ] I have updated the
[documentation](https://github.com/openvinotoolkit/datumaro/tree/develop/docs)
accordingly

### License

- [ ] I submit _my code changes_ under the same [MIT
License](https://github.com/openvinotoolkit/datumaro/blob/develop/LICENSE)
that covers the project.
  Feel free to contact the maintainers if that's a concern.
- [ ] I have updated the license header for each file (see an example
below).

```python
# Copyright (C) 2023 Intel Corporation
#
# SPDX-License-Identifier: MIT
```
 - Change from `sphinx_panels` to `sphinx-design`
 - Update basic skills - 02_dataset_download

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@codecov-commenter
Copy link

codecov-commenter commented Apr 17, 2023

Codecov Report

Patch coverage: 83.15% and project coverage change: +0.04 🎉

Comparison is base (ed3cf05) 78.64% compared to head (08425db) 78.68%.

Additional details and impacted files
@@             Coverage Diff             @@
##           develop     #942      +/-   ##
===========================================
+ Coverage    78.64%   78.68%   +0.04%     
===========================================
  Files          228      231       +3     
  Lines        26342    26408      +66     
  Branches      5249     5257       +8     
===========================================
+ Hits         20717    20780      +63     
+ Misses        4406     4403       -3     
- Partials      1219     1225       +6     
Flag Coverage Δ
macos-11_Python-3.8 77.71% <83.15%> (+0.04%) ⬆️
ubuntu-20.04_Python-3.8 78.66% <83.15%> (+0.04%) ⬆️
windows-2019_Python-3.8 78.57% <83.15%> (+0.04%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
datumaro/cli/util/project.py 33.67% <ø> (ø)
datumaro/components/progress_reporting.py 61.53% <ø> (ø)
...ugins/data_formats/common_semantic_segmentation.py 82.02% <ø> (ø)
datumaro/plugins/data_formats/imagenet.py 91.76% <ø> (ø)
datumaro/plugins/sampler/random_sampler.py 79.62% <ø> (ø)
datumaro/cli/commands/merge.py 21.17% <20.00%> (+0.97%) ⬆️
datumaro/components/environment.py 87.12% <55.00%> (-3.74%) ⬇️
datumaro/components/merge/base.py 74.19% <58.82%> (-19.75%) ⬇️
datumaro/components/visualizer.py 88.97% <74.54%> (-2.32%) ⬇️
datumaro/components/hl_ops/__init__.py 67.08% <75.00%> (-2.15%) ⬇️
... and 13 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@vinnamkim vinnamkim marked this pull request as ready for review April 17, 2023 05:27
@vinnamkim vinnamkim requested review from a team as code owners April 17, 2023 05:27
@wonjuleee wonjuleee requested review from cih9088 and sooahleex April 17, 2023 07:50
@vinnamkim vinnamkim merged commit f57b37c into develop Apr 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants