Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

COWC Dataset #2

Closed
adamjstewart opened this issue Jun 1, 2021 · 0 comments · Fixed by #25
Closed

COWC Dataset #2

adamjstewart opened this issue Jun 1, 2021 · 0 comments · Fixed by #25
Labels
datasets Geospatial or benchmark datasets
Milestone
0.1.0

Comments

@adamjstewart
Copy link
Collaborator

https://gdo152.llnl.gov/cowc/

The Cars Overhead With Context (COWC) data set is a large set of annotated cars from overhead. It is useful for training a device such as a deep neural network to learn to detect and/or count cars.
@adamjstewart adamjstewart added the datasets Geospatial or benchmark datasets label Jun 1, 2021
@adamjstewart adamjstewart mentioned this issue Jun 9, 2021
Merged
@adamjstewart adamjstewart added this to the 0.1.0 milestone Nov 20, 2021
isaaccorley referenced this issue in isaaccorley/torchgeo Nov 22, 2021
@isaaccorley
attempt #2
1a02802
isaaccorley referenced this issue in isaaccorley/torchgeo Nov 23, 2021
@isaaccorley
attempt #2
05e3929
isaaccorley referenced this issue in isaaccorley/torchgeo Nov 28, 2021
@isaaccorley
attempt #2
5e506dd
isaaccorley referenced this issue in isaaccorley/torchgeo Dec 1, 2021
@isaaccorley
attempt #2
42cf88e
isaaccorley referenced this issue in isaaccorley/torchgeo Dec 5, 2021
@isaaccorley
attempt #2
147491f
isaaccorley referenced this issue in isaaccorley/torchgeo Dec 5, 2021
@isaaccorley
attempt #2
6c1e8ab
adamjstewart added a commit that referenced this issue Dec 5, 2021
@isaaccorley @adamjstewart
Add IDTReeS dataset (#201)
0434f3c 
* add IDTReeS dataset

* dataset loads data now

* add optional laspy and pandas dependencies

* fixed docs failing

* format

* refactor verify and resample chm/hsi to 200x200

* add open3d optional dep

* overhaul

* temporarily remove open3d install bc their pypi is broken

* mypy fixes

* fixes per suggestions

* general cleanup

* test passing

* add min version for laspy and pandas

* add open3d dependency

* add open3d to mypy tests

* add hard install for python 3.9 open3d to actions

* attempt #2

* I think I got it now

* updated tests.yaml

* make open3d dep require python<3.9

* open3d has issues with macos python 3.6

* same for 3.7

* skip open3d plot test for macos

* formatting

* skip open3d plot test for windows

* update per suggestions

* update test data readme for las files

* updated per suggestions

* more changes per suggestions

* last change per suggestion

* Grammar fix in pandas dep requirement comment

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
shradhasehgal referenced this issue in shradhasehgal/torchgeo Mar 30, 2023
@shradhasehgal
Fixing comments from review #2
467d9ab
adamjstewart added a commit that referenced this issue Apr 5, 2023
@shradhasehgal @adamjstewart
Add L8 Biome Dataset (#1200)
24afe5a 
* Added varification of data

* Added getitem and plotting functions - partial

* Update torchgeo/datasets/l8biome.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Changes corresponding to draft PR

* Changed auxilliary files for dataset addition; added L8Biome datamodule

* Fixed dataset verification and download; minor changes in variable declaration

* Running linters to properly format code

* Fixing failed linter tests from previous commit

* Fixing comments from review #2

* Added script to generate artificial data in similar format as original files

* Removed dependency on existing dataset

* Fixes to the getitem function; tested with samples

* Making suggested changes; fixing mask; writing tests

* Changes to plot RGB image

* Changes to plot RGB image - running into errors related to band variables declaration

* Fixed plotting of dataset

* Added masks to artificial data generation; tested with pytest - all tests pass

* Resolving file and code formatting with linters

* Added artificial data

* Fixing lists in docstrings

* Fixing comments from review

* Added new tests

* Regenerated artificial data

* Added test for l8datamodule; linters formatting

* Fixed image generation with more rigorous check on filepath

* docstring formatting change

* Resolving CI test errors

* Added conf/yaml for datamodules test

* Fixing CI test failure bug; Changes from review; Samplers in datamodule WIP

* Added more artificial data

* Fixed yaml and datamodule changes

* Running linters to properly format code

* Reducing batch_size and length for datamodules tests

* Reduced patch size in l8biome yaml to fit within artificial data

* Declaring all samplers each time

* Reverting to stages checks for samplers

* Changed data generation file and generated data again

* Fix getitem

* Included more encompassing tests

* Adding test for RGB bands being absent; running linters

* Added check for mask in getitem test

* Changes corresponding to review

* Update torchgeo/datasets/l8biome.py

Downloading raw data directly

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update l8biome.py

* Update torchgeo/datasets/l8biome.py: Changing RGB bands order

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Change B2 band to B1

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
yichiac pushed a commit to yichiac/torchgeo that referenced this issue Apr 29, 2023
@isaaccorley @adamjstewart
Add IDTReeS dataset (microsoft#201)
ff0c4cb 
* add IDTReeS dataset

* dataset loads data now

* add optional laspy and pandas dependencies

* fixed docs failing

* format

* refactor verify and resample chm/hsi to 200x200

* add open3d optional dep

* overhaul

* temporarily remove open3d install bc their pypi is broken

* mypy fixes

* fixes per suggestions

* general cleanup

* test passing

* add min version for laspy and pandas

* add open3d dependency

* add open3d to mypy tests

* add hard install for python 3.9 open3d to actions

* attempt microsoft#2

* I think I got it now

* updated tests.yaml

* make open3d dep require python<3.9

* open3d has issues with macos python 3.6

* same for 3.7

* skip open3d plot test for macos

* formatting

* skip open3d plot test for windows

* update per suggestions

* update test data readme for las files

* updated per suggestions

* more changes per suggestions

* last change per suggestion

* Grammar fix in pandas dep requirement comment

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
yichiac pushed a commit to yichiac/torchgeo that referenced this issue Apr 29, 2023
@shradhasehgal @adamjstewart
Add L8 Biome Dataset (microsoft#1200)
48bc65c 
* Added varification of data

* Added getitem and plotting functions - partial

* Update torchgeo/datasets/l8biome.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Changes corresponding to draft PR

* Changed auxilliary files for dataset addition; added L8Biome datamodule

* Fixed dataset verification and download; minor changes in variable declaration

* Running linters to properly format code

* Fixing failed linter tests from previous commit

* Fixing comments from review microsoft#2

* Added script to generate artificial data in similar format as original files

* Removed dependency on existing dataset

* Fixes to the getitem function; tested with samples

* Making suggested changes; fixing mask; writing tests

* Changes to plot RGB image

* Changes to plot RGB image - running into errors related to band variables declaration

* Fixed plotting of dataset

* Added masks to artificial data generation; tested with pytest - all tests pass

* Resolving file and code formatting with linters

* Added artificial data

* Fixing lists in docstrings

* Fixing comments from review

* Added new tests

* Regenerated artificial data

* Added test for l8datamodule; linters formatting

* Fixed image generation with more rigorous check on filepath

* docstring formatting change

* Resolving CI test errors

* Added conf/yaml for datamodules test

* Fixing CI test failure bug; Changes from review; Samplers in datamodule WIP

* Added more artificial data

* Fixed yaml and datamodule changes

* Running linters to properly format code

* Reducing batch_size and length for datamodules tests

* Reduced patch size in l8biome yaml to fit within artificial data

* Declaring all samplers each time

* Reverting to stages checks for samplers

* Changed data generation file and generated data again

* Fix getitem

* Included more encompassing tests

* Adding test for RGB bands being absent; running linters

* Added check for mask in getitem test

* Changes corresponding to review

* Update torchgeo/datasets/l8biome.py

Downloading raw data directly

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update l8biome.py

* Update torchgeo/datasets/l8biome.py: Changing RGB bands order

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Change B2 band to B1

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
@agarioud agarioud mentioned this issue Oct 3, 2024
Open
@adamjstewart adamjstewart mentioned this issue Dec 12, 2024
Open
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
datasets Geospatial or benchmark datasets
Projects
None yet
Milestone
0.1.0
Development

Successfully merging a pull request may close this issue.

Add COWC Datasets microsoft/torchgeo
1 participant
@adamjstewart