Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JOSS review #38

Merged
merged 112 commits into from
Jul 1, 2022
Merged
Changes from 1 commit
Commits
Show all changes
112 commits
Select commit Hold shift + click to select a range
159385f
Update citation key
a-ws-m Oct 14, 2021
31b43e9
Add maths to NLL documentation (#33)
a-ws-m Oct 14, 2021
1de84ff
Add coveragerc (#28)
a-ws-m Oct 14, 2021
825d0c7
Correct link to issue comment (#21)
a-ws-m Oct 14, 2021
62a2c57
#24
a-ws-m Oct 14, 2021
335c2c4
Add instructions for utilities (#29)
a-ws-m Oct 14, 2021
7c45497
Make save_struct_data public (#27)
a-ws-m Oct 14, 2021
80644f6
Actually test downloading (#22)
a-ws-m Oct 14, 2021
0bcbebb
Exclude large files from workspace watch
a-ws-m Oct 14, 2021
91a3651
Add pytest-cov to tox deps
a-ws-m Oct 14, 2021
4fd766d
Correct package name
a-ws-m Oct 14, 2021
20a5957
Use pytest.approx for floating points (#23)
a-ws-m Oct 14, 2021
c2cfbf1
Remove reference to tensorflow issue
a-ws-m Oct 14, 2021
1112af1
Correct pytest.approx syntax (#23)
a-ws-m Oct 14, 2021
37ea3bf
Test reload functionality in load_data
a-ws-m Oct 14, 2021
fafe25a
[WIP] Metrics testing suite
a-ws-m Oct 15, 2021
e7b4cb2
Citation (#24)
a-ws-m Oct 19, 2021
2b26f1b
Change RTD Slug (#20)
a-ws-m Oct 21, 2021
5683f30
Add save_struct_data to docs (#27)
a-ws-m Oct 21, 2021
af8f028
Add pytest-mock to test installs
a-ws-m Oct 21, 2021
7c5c17d
Hide metrics tests whilst WIP
a-ws-m Oct 21, 2021
fb54187
Split up model tests (#25)
a-ws-m Oct 21, 2021
a2ac525
Correct variation description
a-ws-m Oct 21, 2021
de19247
Add metrics tests (#26)
a-ws-m Oct 21, 2021
e22576e
Don't cover backwards compatible checks (use tox)
a-ws-m Oct 22, 2021
46b0911
Add a test for custom kernels
a-ws-m Oct 22, 2021
4298d05
Clarify amplitude and length_scale (#32)
a-ws-m Oct 22, 2021
57e793c
Correct TestKernel implementation to match docs
a-ws-m Oct 22, 2021
7072967
Add amplitude and ls to docs (#32)
a-ws-m Oct 22, 2021
ba6c627
[FIX] amplitude and ls property types (#32)
a-ws-m Oct 22, 2021
4a746c1
[WIP] Warnings suppresion
a-ws-m Oct 23, 2021
1dad84a
Warnings handling (#30)
a-ws-m Oct 25, 2021
111cda1
Target audience (openjournals/joss-reviews#3793)
a-ws-m Oct 25, 2021
65ceb43
Add freezing/thawing tests (#26)
a-ws-m Oct 25, 2021
e1cea74
Add black to workspace formatter settings
a-ws-m Oct 25, 2021
99579d4
MEGNet utils testing (#26)
a-ws-m Oct 25, 2021
5b68426
Add clarifying info on package structure (#19)
a-ws-m Oct 25, 2021
d86bab5
[WIP] Benchmarking for MP2019
a-ws-m Oct 26, 2021
75edfc7
Enable training and inference with graphs
a-ws-m Oct 26, 2021
540dfca
Merge pull request #34 from a-ws-m:feature/graph_training
a-ws-m Oct 26, 2021
98c27f3
Update kwargs to reflect possible graph input
a-ws-m Oct 26, 2021
cfe1c38
Update benchmark script to use graphs
a-ws-m Oct 26, 2021
c7be46d
Don't use band gap
a-ws-m Oct 26, 2021
5e3aff8
Fix case where no inducing points are set
a-ws-m Oct 26, 2021
f52ee58
Fix datetime call
a-ws-m Oct 27, 2021
a4e99b0
Add df debug statement
a-ws-m Oct 27, 2021
9cafceb
Training data debug
a-ws-m Oct 27, 2021
0354d8c
Validation data debug
a-ws-m Oct 27, 2021
cf64388
Correct dataframe queries
a-ws-m Oct 27, 2021
2ec48e7
Fix docstring
a-ws-m Oct 27, 2021
caaf935
More debug info
a-ws-m Oct 27, 2021
c4898f0
Fix for indexing error
a-ws-m Oct 27, 2021
d6b1a00
Add training component switch
a-ws-m Nov 3, 2021
db1ca68
Debugging weight names
a-ws-m Nov 3, 2021
861e880
Fix Model reference
a-ws-m Nov 3, 2021
82f0965
Enable loading using string path
a-ws-m Nov 17, 2021
51a2cbe
More debugging of weight names
a-ws-m Nov 17, 2021
2cd344a
Debugging: don't freeze layers
a-ws-m Nov 17, 2021
cfb786e
More fine-grained debugging
a-ws-m Nov 17, 2021
0d2ba0a
Remove obsolete recompilation for inference
a-ws-m Nov 17, 2021
e55e592
More debugging statements
a-ws-m Nov 17, 2021
3d8722a
Debugging statements
a-ws-m Nov 17, 2021
bade67d
Hardcode freezing logic
a-ws-m Nov 17, 2021
546238d
Debug flag
a-ws-m Nov 17, 2021
dba8c18
Fallback KL weight to current one on recompile
a-ws-m Nov 18, 2021
b1fb445
Fix reference to old kwarg
a-ws-m Nov 19, 2021
3dbec5d
Revert to flexible freezing + add checks
a-ws-m Nov 19, 2021
0435d66
Refactoring + change default training batch size
a-ws-m Nov 22, 2021
5849b66
Add weights duplication test
a-ws-m Nov 22, 2021
c5add8f
Boilerplate model benchmarking code
a-ws-m Nov 22, 2021
1109152
Rename benchmarking utils
a-ws-m Nov 22, 2021
1ad70f9
Matbenching boilerplate
a-ws-m Nov 22, 2021
cf9eb66
Matbench perovskites and phonons benchmarks
a-ws-m Nov 22, 2021
0ffac10
Fix benchmark scripts
a-ws-m Nov 22, 2021
a0c5d39
Validation metrics and tuning
a-ws-m Nov 22, 2021
3b6a3eb
Add batch size arguments
a-ws-m Nov 22, 2021
0e6202e
Update default megnet metric
a-ws-m Nov 23, 2021
921d7ee
Fix series types
a-ws-m Nov 23, 2021
9706f15
Replace checkpoint loading attr with CLI arg
a-ws-m Dec 2, 2021
f25ab6a
Make root_dir a command line argument
a-ws-m Dec 13, 2021
c536ca4
Add data_only flag
a-ws-m Dec 13, 2021
b21e2f7
Fix data-only destination
a-ws-m Dec 13, 2021
12e248b
Add kanban to recommended extensions
a-ws-m Dec 13, 2021
a80412b
Replace kanban extension
a-ws-m Dec 13, 2021
e9efe33
Add kanbn
a-ws-m Dec 13, 2021
0c6415a
Fix required fold for data only mode
a-ws-m Dec 18, 2021
e47159b
Fix typo
a-ws-m Dec 18, 2021
ea39205
Fix folding issue
a-ws-m Dec 18, 2021
60b255a
Fix ArgumentError arguments
a-ws-m Jan 18, 2022
f08e79e
Merge branch 'joss-review' of github.com:a-ws-m/unlockNN into joss-re…
a-ws-m Jan 18, 2022
74ce5d8
Fix model dirname method
a-ws-m Jan 19, 2022
59ef78b
Fix ignore_ckpt CLI arg
a-ws-m Feb 11, 2022
c92881d
Fix numpy array inputs to `predict`
a-ws-m Feb 11, 2022
f69d96f
Fix validation metrics path
a-ws-m Feb 11, 2022
c3a0da4
Perovskites benchmark results + vis
a-ws-m Feb 12, 2022
d8faf9b
Update Kanban
a-ws-m Mar 2, 2022
4fe0a86
Results visualisation
a-ws-m Mar 2, 2022
221d7ca
Fix MEGNet metric evaluation
a-ws-m Mar 17, 2022
064a080
Add phonons results + metrics
a-ws-m Apr 5, 2022
ad52a2e
Write probabilistic predictions to disk for `eval`
a-ws-m Jun 23, 2022
40acdc3
Fix targets to write
a-ws-m Jun 23, 2022
2afaf50
[WIP] Uncertainty results visualisation
a-ws-m Jun 23, 2022
12fd4fa
[WIP] First draft of UQ plot code
a-ws-m Jun 24, 2022
0d9389b
Move graphs to appropriate directory
a-ws-m May 3, 2022
61b90dd
Remove obsolete kanban
a-ws-m May 3, 2022
ff68ea6
Compile when loading
a-ws-m Jun 28, 2022
368f18e
Add model predictions
a-ws-m Jun 28, 2022
7b640c3
Calibration and parity plots
a-ws-m Jun 28, 2022
b78256b
Get average metrics and show legend
a-ws-m Jun 30, 2022
a8e5fc9
[WIP] Add benchmarks info
a-ws-m Jun 30, 2022
45ec0e2
Finalise benchmarks info JOSS Review #19
a-ws-m Jun 30, 2022
e2090c8
Clarify parity plots
a-ws-m Jun 30, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add model predictions
a-ws-m committed Jun 28, 2022
commit 368f18e9bd920909c665f3382dfff761c8e12f9f
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
,0
nll,-3171.854326599779
sharpness,0.1464632610209496
variation,0.0668022354935111
mae,0.05860692641771554
mse,0.0072759152604544635
rmse,0.08529897572922235
nll,-3171.8540732051724
sharpness,0.14646325494048992
variation,0.06680225375026387
mae,0.05860692061477788
mse,0.007275915051778311
rmse,0.08529897450601802

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
,0
nll,-625.112004807598
sharpness,0.14692264731896817
variation,0.07904824702347016
mae,0.05737590640896092
mse,0.0076101603929093296
rmse,0.08723623325722707
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
,0
nll,-3040.080900898984
sharpness,0.1410159245221959
variation,0.06951748705145898
mae,0.06957198204435913
mse,0.009688912569703988
rmse,0.0984322740248542
nll,-3040.649378790641
sharpness,0.141014484253851
variation,0.06945765527180832
mae,0.06954177476542028
mse,0.009682879815461343
rmse,0.09840162506514485

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
,0
nll,-644.782736074262
sharpness,0.1400028817288066
variation,0.024429019685080704
mae,0.0658650896849907
mse,0.007826916064479997
rmse,0.08846985963863624
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
,0
nll,-3854.478100119898
sharpness,0.1131037117661296
variation,0.16183759943432532
mae,0.058274271979578095
mse,0.00687423010005872
rmse,0.0829109769575701
nll,-3854.3778111384822
sharpness,0.11310556017543177
variation,0.16190198776702105
mae,0.058287804124489376
mse,0.006874543982554624
rmse,0.08291286982462145

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
,0
nll,-764.8152795529834
sharpness,0.11283307961766442
variation,0.16936067946451264
mae,0.05731681246720316
mse,0.006858972124682125
rmse,0.08281891163666741
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
,0
nll,-3819.349557750498
sharpness,0.11006687253952145
variation,0.08306440329728342
mae,0.05971151535402427
mse,0.006892787288930445
rmse,0.0830228118587322
nll,-3819.3476605799733
sharpness,0.11006687537743244
variation,0.08306439374795258
mae,0.05971151392887952
mse,0.0068927999060835275
rmse,0.08302288784475957
Loading