Skip to content

Commit

Permalink
nabenabe0928: [feat] Add templates for issue and PR with the Ravin's …
Browse files Browse the repository at this point in the history
…suggestions (#136)
  • Loading branch information
Github Actions committed Nov 22, 2021
1 parent 3ce44b4 commit d0e99df
Show file tree
Hide file tree
Showing 26 changed files with 373 additions and 351 deletions.
Binary file not shown.
Binary file not shown.
Binary file modified development/_images/sphx_glr_example_visualization_001.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified development/_images/sphx_glr_example_visualization_002.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified development/_images/sphx_glr_example_visualization_thumb.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
Expand Up @@ -85,27 +85,25 @@ Image Classification
Pipeline Random Config:
________________________________________
Configuration:
image_augmenter:GaussianBlur:sigma_min, Value: 0.1623238579793036
image_augmenter:GaussianBlur:sigma_offset, Value: 0.08926671305424805
image_augmenter:GaussianBlur:use_augmenter, Value: True
image_augmenter:GaussianBlur:use_augmenter, Value: False
image_augmenter:GaussianNoise:use_augmenter, Value: False
image_augmenter:RandomAffine:rotate, Value: 311
image_augmenter:RandomAffine:scale_offset, Value: 0.21908415544868545
image_augmenter:RandomAffine:shear, Value: 28
image_augmenter:RandomAffine:translate_percent_offset, Value: 0.3535159682634085
image_augmenter:RandomAffine:rotate, Value: 217
image_augmenter:RandomAffine:scale_offset, Value: 0.1179816731477697
image_augmenter:RandomAffine:shear, Value: 4
image_augmenter:RandomAffine:translate_percent_offset, Value: 0.36434471663235696
image_augmenter:RandomAffine:use_augmenter, Value: True
image_augmenter:RandomCutout:p, Value: 0.21707094236232952
image_augmenter:RandomCutout:p, Value: 0.7356259878600178
image_augmenter:RandomCutout:use_augmenter, Value: True
image_augmenter:Resize:use_augmenter, Value: True
image_augmenter:ZeroPadAndCrop:percent, Value: 0.2769344198091167
normalizer:__choice__, Value: 'NoNormalizer'
image_augmenter:ZeroPadAndCrop:percent, Value: 0.07020163504895205
normalizer:__choice__, Value: 'ImageNormalizer'

Fitting the pipeline...
________________________________________
ImageClassificationPipeline
________________________________________
0-) normalizer:
NoNormalizer
ImageNormalizer

1-) preprocessing:
EarlyPreprocessing
Expand Down Expand Up @@ -177,7 +175,7 @@ Image Classification
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 0 minutes 6.795 seconds)
**Total running time of the script:** ( 0 minutes 8.752 seconds)


.. _sphx_glr_download_examples_20_basics_example_image_classification.py:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -134,7 +134,7 @@ Search for an ensemble of machine learning algorithms
.. code-block:: none
<autoPyTorch.api.tabular_classification.TabularClassificationTask object at 0x7f1a2f2045e0>
<autoPyTorch.api.tabular_classification.TabularClassificationTask object at 0x7fdb1008e310>
Expand Down Expand Up @@ -165,24 +165,26 @@ Print the final ensemble performance

.. code-block:: none
{'accuracy': 0.8554913294797688}
| | Preprocessing | Estimator | Weight |
|---:|:----------------------------------------------------------|:----------------------------------------------------------------|---------:|
| 0 | None | RFLearner | 0.24 |
| 1 | SimpleImputer,OneHotEncoder,Normalizer,KernelPCA | embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.22 |
| 2 | None | SVMLearner | 0.18 |
| 3 | None | CBLearner | 0.1 |
| 4 | None | ETLearner | 0.08 |
| 5 | None | KNNLearner | 0.08 |
| 6 | SimpleImputer,OneHotEncoder,MinMaxScaler,PowerTransformer | embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
| 7 | SimpleImputer,NoEncoder,Normalizer,Nystroem | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
| 8 | None | LGBMLearner | 0.02 |
{'accuracy': 0.838150289017341}
| | Preprocessing | Estimator | Weight |
|---:|:------------------------------------------------------------------|:----------------------------------------------------------------|---------:|
| 0 | SimpleImputer,OneHotEncoder,Normalizer,KernelPCA | embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.2 |
| 1 | None | KNNLearner | 0.16 |
| 2 | None | CBLearner | 0.14 |
| 3 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.12 |
| 4 | SimpleImputer,OneHotEncoder,Normalizer,PowerTransformer | embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.08 |
| 5 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.08 |
| 6 | SimpleImputer,OneHotEncoder,MinMaxScaler,PowerTransformer | embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.06 |
| 7 | SimpleImputer,NoEncoder,Normalizer,Nystroem | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.06 |
| 8 | None | SVMLearner | 0.04 |
| 9 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
| 10 | SimpleImputer,OneHotEncoder,MinMaxScaler,TruncSVD | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
autoPyTorch results:
Dataset name: Australian
Optimisation Metric: accuracy
Best validation score: 0.8713450292397661
Number of target algorithm runs: 26
Number of successful target algorithm runs: 23
Number of target algorithm runs: 22
Number of successful target algorithm runs: 19
Number of crashed target algorithm runs: 2
Number of target algorithms that exceeded the time limit: 1
Number of target algorithms that exceeded the memory limit: 0
Expand All @@ -194,7 +196,7 @@ Print the final ensemble performance
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 5 minutes 34.659 seconds)
**Total running time of the script:** ( 5 minutes 35.978 seconds)


.. _sphx_glr_download_examples_20_basics_example_tabular_classification.py:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -125,7 +125,7 @@ Search for an ensemble of machine learning algorithms
.. code-block:: none
<autoPyTorch.api.tabular_regression.TabularRegressionTask object at 0x7f1ad16c9ca0>
<autoPyTorch.api.tabular_regression.TabularRegressionTask object at 0x7fdbb2e14ca0>
Expand Down Expand Up @@ -159,21 +159,21 @@ Print the final ensemble performance

.. code-block:: none
{'r2': 0.9445248186059718}
{'r2': 0.944631023189658}
| | Preprocessing | Estimator | Weight |
|---:|:------------------------------------------------------------------|:----------------------------------------------------------------|---------:|
| 0 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.44 |
| 1 | None | CBLearner | 0.42 |
| 2 | None | LGBMLearner | 0.08 |
| 3 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.06 |
autoPyTorch results:
Dataset name: 6c0d5e21-4b95-11ec-877e-173600507718
Dataset name: 90fc86f3-4b99-11ec-8767-3dd3e59f8cae
Optimisation Metric: r2
Best validation score: 0.8645385039886702
Number of target algorithm runs: 31
Number of successful target algorithm runs: 27
Best validation score: 0.8644967965917701
Number of target algorithm runs: 23
Number of successful target algorithm runs: 18
Number of crashed target algorithm runs: 3
Number of target algorithms that exceeded the time limit: 1
Number of target algorithms that exceeded the time limit: 2
Number of target algorithms that exceeded the memory limit: 0
Expand All @@ -183,7 +183,7 @@ Print the final ensemble performance
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 5 minutes 31.626 seconds)
**Total running time of the script:** ( 5 minutes 36.832 seconds)


.. _sphx_glr_download_examples_20_basics_example_tabular_regression.py:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,12 +5,12 @@

Computation times
=================
**11:13.080** total execution time for **examples_20_basics** files:
**11:21.562** total execution time for **examples_20_basics** files:

+--------------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_examples_20_basics_example_tabular_classification.py` (``example_tabular_classification.py``) | 05:34.659 | 0.0 MB |
| :ref:`sphx_glr_examples_20_basics_example_tabular_regression.py` (``example_tabular_regression.py``) | 05:36.832 | 0.0 MB |
+--------------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_examples_20_basics_example_tabular_regression.py` (``example_tabular_regression.py``) | 05:31.626 | 0.0 MB |
| :ref:`sphx_glr_examples_20_basics_example_tabular_classification.py` (``example_tabular_classification.py``) | 05:35.978 | 0.0 MB |
+--------------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_examples_20_basics_example_image_classification.py` (``example_image_classification.py``) | 00:06.795 | 0.0 MB |
| :ref:`sphx_glr_examples_20_basics_example_image_classification.py` (``example_image_classification.py``) | 00:08.752 | 0.0 MB |
+--------------------------------------------------------------------------------------------------------------+-----------+--------+
Original file line number Diff line number Diff line change
Expand Up @@ -46,44 +46,44 @@ the search. Currently, there are two changes that can be made to the space:-

.. code-block:: none
{'accuracy': 0.861271676300578}
{'accuracy': 0.8670520231213873}
| | Preprocessing | Estimator | Weight |
|---:|:------------------------------------------------------------------|:----------------------------------------------------------|---------:|
| 0 | None | CBLearner | 0.44 |
| 1 | SimpleImputer,OneHotEncoder,Normalizer,PolynomialFeatures | no embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.22 |
| 2 | SimpleImputer,OneHotEncoder,StandardScaler,Nystroem | embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.16 |
| 3 | None | ETLearner | 0.06 |
| 4 | None | SVMLearner | 0.06 |
| 5 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
| 6 | None | RFLearner | 0.02 |
| 0 | None | RFLearner | 0.44 |
| 1 | None | ETLearner | 0.26 |
| 2 | None | LGBMLearner | 0.1 |
| 3 | None | SVMLearner | 0.08 |
| 4 | None | KNNLearner | 0.08 |
| 5 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
| 6 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
autoPyTorch results:
Dataset name: bd824053-4b99-11ec-877e-173600507718
Dataset name: e8fd2f8e-4b9d-11ec-8767-3dd3e59f8cae
Optimisation Metric: accuracy
Best validation score: 0.8654970760233918
Number of target algorithm runs: 20
Number of successful target algorithm runs: 16
Number of crashed target algorithm runs: 3
Best validation score: 0.8596491228070176
Number of target algorithm runs: 17
Number of successful target algorithm runs: 11
Number of crashed target algorithm runs: 5
Number of target algorithms that exceeded the time limit: 1
Number of target algorithms that exceeded the memory limit: 0
{'accuracy': 0.861271676300578}
| | Preprocessing | Estimator | Weight |
|---:|:--------------------------------------------------------------|:----------------------------------------------------------------|---------:|
| 0 | SimpleImputer,NoEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.28 |
| 1 | None | RFLearner | 0.24 |
| 2 | None | KNNLearner | 0.16 |
| 3 | SimpleImputer,NoEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.12 |
| 4 | None | CBLearner | 0.08 |
| 5 | SimpleImputer,NoEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.06 |
| 6 | SimpleImputer,NoEncoder,StandardScaler,KernelPCA | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
| 7 | None | ETLearner | 0.02 |
| 8 | None | SVMLearner | 0.02 |
| 0 | SimpleImputer,NoEncoder,Normalizer,PowerTransformer | no embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.26 |
| 1 | None | KNNLearner | 0.14 |
| 2 | SimpleImputer,NoEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.12 |
| 3 | None | RFLearner | 0.1 |
| 4 | SimpleImputer,NoEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.1 |
| 5 | None | ETLearner | 0.08 |
| 6 | None | SVMLearner | 0.08 |
| 7 | SimpleImputer,NoEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.08 |
| 8 | None | LGBMLearner | 0.04 |
autoPyTorch results:
Dataset name: 25ff5b40-4b9a-11ec-877e-173600507718
Dataset name: 532e1290-4b9e-11ec-8767-3dd3e59f8cae
Optimisation Metric: accuracy
Best validation score: 0.8654970760233918
Number of target algorithm runs: 22
Number of successful target algorithm runs: 16
Best validation score: 0.8596491228070176
Number of target algorithm runs: 20
Number of successful target algorithm runs: 14
Number of crashed target algorithm runs: 5
Number of target algorithms that exceeded the time limit: 1
Number of target algorithms that exceeded the memory limit: 0
Expand Down Expand Up @@ -220,7 +220,7 @@ the search. Currently, there are two changes that can be made to the space:-
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 5 minutes 47.143 seconds)
**Total running time of the script:** ( 5 minutes 57.544 seconds)


.. _sphx_glr_download_examples_40_advanced_example_custom_configuration_space.py:
Expand Down
Loading

0 comments on commit d0e99df

Please sign in to comment.